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Abstract 

Interference is a fundamental feature of the wireless channel. The two- user Gaussian 
^ interference channel where the destination nodes can both talk and listen is studied. 

O Using novel inner and outer bounds the sum-capacity of this channel is characterized 

up to a constant number of bits. 

> 

O 1 Introduction 

Orthogonalization and treating interference as noise are the two most common ways of 
handling interference in practical wireless communication systems. However, it is well-known 
that better rates of operation may be achieved when the interfering systems are designed 
jointly (interference channels) [HE]. Superposition coding and interference alignment has 
been shown to perform well in interference channels (where the sources only transmit and 
destinations only receive) [2] [3] . 

A further degree of cooperation is possible when the radios can both listen and transmit. 
Understanding the gains from this form of cooperation is the goal of this paper. We study 
a two-user Gaussian interference channel where the destinations are also equipped with 
transmit capabilities. This sets up the possibility of cooperation among the destination 
nodes. The cooperative links are over the same frequency band as the rest of the links. In 
this paper, we study the sum-rate when the destination nodes operate in full-duplex. The 
main result is a characterization of the sum-rate within a constant number of bits. The 
constant we obtain is 40 bits, but we discuss how this gap could be improved. The two- 
user interference channel where the source radios have receive capabilities was explored in a 
companion paper [TO] . 

A scheme based on superposition coding of Cover [5] was proposed by Han and Kobayashi |4J 
for the two-user interference channel. Recently, Etkin, Tse, and Wang [2] showed that the 
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scheme of Han and Kobayashi achieves the capacity to within one bit of the two-user Gaus- 
sian interference channels. The scheme of Han and Kobayashi involves the two destinations 
partially decoding the interference they receive. In order to facilitate this, the sources encode 
their messages as a superposition of two partial messages. One of these partial messages, 
termed the public message, is decoded by the destination where it appears as interference 
along with the two partial messages which are meant for this destination. The other partial 
message, called the private message, from the interfering source is treated as noise. Our 
achievable scheme preserves these two types of messages and employs a further two types of 
messages: 

• Cooperative private messages are decoded by the destination to which is intended, but 
unlike private messages, they benefit from cooperation. The effect of cooperation is to 
ensure that these messages do not appear as interference at the destination to which 
they are not intended. This is achieved using a nulling scheme. 

• Cooperative public messages are decoded by both destinations, and unlike public mes- 
sages, they benefit from cooperation. The form of cooperation involves destinations 
exchange messages with each other which carry information on their past observations. 
This has similarities to compress- and- forward schemes used in relay channels [UJ. 

We also derive novel upperbounds on the sum-rate to show that these modes of cooperation 
are optimal up to a constant gap. 

Related works include [7j which studies a similar setting and [8] which studies a two-stage, 
two-source interference network. 

2 Problem Statement 

We consider the following model for destination cooperation (see Figure [I]). At each discrete- 
time instant - indexed by t = 1, 2, ... - the source nodes 1 and 2 send out, respectively, Xi[t] 
and X2[t] which belong to the set C of complex numbers. The destination nodes 3 and 4 
can not only receive, but also transmit over the same channel. Let X 3 [t] and X&[t] G C, 
respectively, denote what nodes 3 and 4 transmit at time t. Then the destination nodes 
receive 

Y 3 [t] = 01,3*1 [t] + 02,3*2 [t] + 04,3*4 [t] + N 3 [t], 
YM = 2) 4*2 [t] + 01,4*1 [t] + 03,4*3 [*] + N 4 [t], 

where N 3 [t] and N^[t] are i.i.d. (over t), circularly symmetric, zero-mean, unit variance, 
complex Gaussian random variables which are independent of each other. The ! s are con- 
stant, complex channel coefficients which are assumed to be known to all the nodes. We 
impose a natural causality constraint on the transmissions from the destination nodes - the 
transmissions from each destination is a deterministic function of everything it has received 
up to the previous time instant, i.e., 

X k [t] = f k)t (Y*- 1 ), fc = 3,4. 
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The source nodes 1 and 2 map their messages (which are assumed to be uniformly distributed 
over their alphabets and denoted by Mi and M 2 , respectively) to their channel inputs using 
deterministic encoding functions. 



It is easy to see that, without loss of generality, we may consider a channel where the channel 
coefficients g% t3 , g 2>i , #3,4, #4,3 are replaced by their magnitudes |<7i,3|, |<72,4|, |<?3,4| , 1^4,3 1 , an d 
the channel coefficient g\^ is replaced by \g\^e? e ^ 2 and g 2:3 is replaced by |g 2j3 |e j61 / 2 , where 
6 = f arg((yfi i4 ) + arg(g 2j3 ) — arg(gi j3 ) — arg(g 2]4 ). We will consider this channel. We will also 
assume that |g 3]4 | = |<74 )3 | = gc, say, which models the reciprocity of the link between nodes 
3 and 4. Further, we will consider unit power constraints which is without loss of generality 
when both destinations have the same power constraint. Thus, a blocklength-T codebook 
of rate (Ri, R 2 ) is a sequence of encoding functions, f k j, t — 1,2, ... ,T as described above 
such that 



with message alphabets M k = {1, 2, . . . , 2 TRk }, k = 1,2 over which the messages M k are 
uniformly distributed, and decoding functions f k+2 : C T M. k . We say that a rate [R\, R 2 ) 
is achievable if there is sequence of rate (Ri, R 2 ) codebooks such that as T — > 00, 



In this paper, we are interested in the largest -Ri + R 2 such that (R±, R 2 ) is achievable. 

We would also like to consider a linear deterministic model [9] for the above channel. In 
order to treat both models together, we will adopt the following notation: The destination 
nodes receive 



X k [t] = f ktt (M k ), k — 1,2, 



E ^EW]T <1, fc = l,2,3,4, 



P(/ fe+2 (n T +2 )^M fc ) -0, k = 1,2. 



Y 3 [t) = g 1)3 {Xi[t)) + g* 2)3 (X 2 [t]) + g^{X A [t}), 
Yt[t) = thAMt)) + 9*iAMt}) + 93A(X 3 [t]), 




Gaussian case: 



92a(X 2 ) 
£s(*i) 

93a(X 3 ) 
^4,3(^4) 




g 2 , 3 X 4 + N 3 , 
g 1A Xx + N 4 , 
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Figure 1: Problem Setup 



Note that g*'s denote randomized maps while g's are deterministic. 

Linear deterministic case: Let 711,3,712,3, 711,4,712,4, 713,4,714,3 be non-negative integers and 
n = f max(ni, 3 , n 2 ,3, 77i, 4 , n 2 ,4, n 3 , 4 , 774,3). The inputs to the channel Xi and X 2 are 77-length 
vectors over a finite field F. Let S the n x n shift matrix. 



We define 
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nxn 




= S n ' 


- ni ' 3 X 1 , 


#2,4(^2) 


= S n " 






= S n " 






= S n " 


-"2,3 V 
' ^2; 


^3,4(^3) 


= S n ' 


""3,4 V 


^4,3(^4) 


= S n " 


" n4 - 3 X 4 . 



Further, to model the reciprocity of the links between the two receivers, we set 773,4 = 774,3 — 
nc- The set of achievable {R^R^) are defined as in the Gaussian case. 



3 Main Results 

We will first state our main result on the sum-rates of the channels presented in the previous 
section. Then we illustrate the gains resulting from cooperation using an example. 
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3.1 Sum- rate Characterization 



Theorem 1 Linear deterministic case. The sum-capacity of the linear deterministic channel 
with source cooperation is the minimum of the following 



u x = max(n li3 - n M + n c , n 2<3 , n c ) + max(n 2i4 - n 2 , 3 + n c, ™i,4, n c ), 

u 2 = max(n 2 , 4 , n 2 , 3 ) + (max(n li3 , n 2i3 , n c ) - n 2 , 3 ) , 

u 3 = max(ni i3 , 711,4) + (max(n 2j4 , n M , n c ) - n 1A ) , 

w 4 = max(ni i3 , n c ) + max(n 2i4 , nc), and 

f max(rii i3 + n 2>4 , n lA + n 2)3 ), ifn 1>3 - n 2j3 ^ n 1A - n 2A , 
I max(ra 1 3 , n 2 4, n\ 4 , n 2 3 ), otherwise. 



u 5 



(1) 
(2) 
(3) 
(4) 

(5) 



The condition n 13 — n 23 = ni i4 — n 2 4 refers to a degenerate case where one of the desti- 
nations is degraded with repect to the other, i.e., the signal that one of the destinations 
receives is part of what the other receives. We prove the achievability in appendix [C] and 
the upperbound in appendix |E} 

Theorem 2 Gaussian case. The sum-capacity of the Gaussian channel with source cooper- 
ation is at most the minimum of the following five quantities and a sum-rate can be achieved 
(within a gap of at most 40 bits) of this minimum^ 



31,4 



+ 



log (1 + (J#2 )3 | + \g c \ + 
log (l + (lfl-2,31 + \9c\ + \9i,a\) 
log (l + (\g 1A \ + \g c \ + ^ 



+ 



31,3 
1 31,4 



32.3 



+ 



32. 1 



32.3 



U>2 



log (l + (131,4 1 + \gc\ + 102,4 1)' 

log(l + (\g li3 \ + \g 2 , 3 \ + \g c \) 2 ) + log ( 1 + 



*/ I^M I > max(l, \g c \) 
otherwise 

if \92,3\ > max(l, \g c \) 
otherwise, 





02,4 


I 2 ^ 


max 


(1,1 

01,3 


92,3 
2 




max 


(1,1 


9iA 


,) 



u 3 = log(l + (\g 2A \ + |0 M | + \gc\f) + log (l + 
u 4 = log (l + {\g 1>3 \ + \g c \f) + log (l + (\g 2 ,4 + \gc\f 
u 5 = log ^1 + 2 (|^i, 3 | 2 + |# 2 , 4 | 2 + \g 1A \ 2 + |# 2)3 | 2 ) 

+ 4 (|0i, 3 2)4 | 2 + |01,402, 3 | 2 - %1,302,401,402, 3 | C0S6») ^J. 

The achievability is proved in appendix [D] and the upperbound in appendix [E| 
1 A11 logarithms in this paper are to the base 2. 



(6) 

(7) 

(8) 
(9) 

(10) 
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C D = log (! + <&) 



1 1 3 log I gel 2 

4 2 log 

Figure 2: Normalized sum-capacity of the symmetric interference channel with gj = 
^fg~D under source cooperation in the limit of gu — > oo keeping log |(7/| 2 / log \go\ 2 and 
loglS'clVioglS'Dl 2 fixeci - 

3.2 Gains from cooperation 

Let us consider the following two-user Gaussian interference channel to see the gains from 
cooperation: \g x ^\ = \g 2A \ = 9d, \gi,4 = |#2,3 1 = 9i = y/g~D, and arbitrary 9. In Fig. |2j we 
plot the upperbound on the sum-rate from Theorem [2] normalized by the capacity of the 
direct link, as a function of log |gc| 2 /log \go\ 2 , in the limit of \gr>\ — > oo while keeping the 
ratios log \gc\ 2 / log \go\ 2 and log \gi\ 2 / log \go\ 2 constant. Since this upperbound is achievable 
within a constant gap, this plot is also that of the sum-capacity in this limit. There are three 
distinct regimes. 

• log \gc\ 2 / log \go\ 2 < 1/2. In this regime, the plot shows that the capacity increases 
linearly with the strength of the cooperation link (measured in the dB scale). For every 
3dB increase in link strength the sum-capacity increases by 2 bits. As will become clear 
in the sequel, the benefits of cooperation in this regime come from messaging using 
cooperative private messages. 

• 1/2 < log \gc\ 2 / log \9d\ 2 < 1- The linear gain saturates when the cooperation link 
strength is half the direct link strength. No further gains are available until the coop- 
eration link is as strong as the direct link. 

• 1 < log | gc | 2 1 log \go\ 2 < 3/2. The capacity again increases linearly with the coopera- 
tion link strength, but here an increase in capacity by 2 bits requires a 6dB increase in 
the cooperation channel strength. This linear increase continues until the cooperation 
capacity is approached when the cooperation link is 3/2 times as strong as the direct 
link, after which the capacity is flat. The cooperative gains in this regime result from 
using cooperative public messages. 
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4 Coding schemes: Illustrative examples 



In this section we will present two linear deterministic channel examples to illustrate our 
achievable scheme. The examples have been chosen such that essentially signal processing 
schemes (i.e., schemes which involve no coding) can achieve the sum-capacity. Our achievable 
scheme for the general problem relies on the basic intuition illustrated here. 

Han and Kobayashi's achievable scheme for interference channels without cooperation 
involves two kinds of signals: (a) public signals which are decoded by all the destinations and 
(b) private signals which are decoded only by the destinations to which they are intended and 
treated as noise by all the other destinations. Our coding scheme involves two other forms 
of signals. The first example introduces a third type of signal called the cooperative private 
signal. It also shows that the private signal itself comes in two varieties now. Example 2 
introduces a fourth type of signal called the cooperative public signal. 



4.1 Example 1 

Consider the symmetric linear deterministic channel with direct links n 13 = n 2 ^ = rio, say, 
and interference links ni j4 = n 23 = rij, say, such that n D = 5 and rij = 2. When source 
cooperation is absent, i.e., ric = 0, the sum capacity is 6. With a cooperative link of ric = 1, 
the sum-capacity turns out to be 8. A scheme which achieves this is as follows: The sources 
transmit 

/ uM \ ( u 2 [t] \ 



xi[t] = 



V 



Ul[t] 

vi[t] 
vi[t + l] 



and x 2 [t] = 



v 2 [t] 
z ]2 [t] 
v 2 [t + l} 



where i>fc(l) = Vk(T + 1) = 0, k — 1,2. The destination nodes will receive the following 
signals 



2/3 [*] 





U1 [t] \ 




( ^ 




( 









vi[t] 




















+ 





+ 











Vi[t+1] 




u 2 [t] 











V 






\ MA J 






-{v 2 [t\ + Ul [t- 






Ul[t] 











vi[t] 

Ul[*+1] +u 2 [t] 
V Z lM -U![t-1] J 



and similarly 
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( u 2 [t] \ 

V2[t] 

z 12 [t] 

V 2 [t+ 1] +Ui[*] 

V z l2 [t\ -u 2 [t- 1] y 



if they transmit at time t 



/ -K[t] + w 2 [t-i]) \ 
_( Zil [t_i] - Ul [t-i}) 







and Xi[t] 



( -(v 2 [t]+ Ul [t-l}) \ 
-(z l2 [t - 1] - u 2 [t - 1]) 






Clearly, the destinations nodes may transmit the above signals in this example and des- 
tination 3 can recover the signals vi[t], z^i[t], z±i[t], , u 2 [i\) : t = 1,2, ...T} while 
destination 4 can recover the signals {i^M, v 2 [t] : z^ 2 [t\, z^\t], Ui[t] : t = 1,2, ...T}. This 
implies that a rate Ri = 4 (and similarly R 2 = 4) is achievable. 

But we now interpret the steps involved at the destinations with an additional restriction 
that they can access lower levels of their observations only if the signals contributing to the 
higher levels have been recovered. As we will see in the next section, this restriction allows us 
to extend this scheme to a more general scheme which also works in the Gaussian case. The 
rough intuition is that the scheme will treat the signals in the lower levels, which represent 
lower power levels in the Gaussian context, as noise while processing the higher levels. And 
if a higher level has not been decoded, then the lower levels are essentially "drowned out" 
by the higher power of the undecoded signals. 

At the end of time t, destination 3 recovers Ui[t], Vi[t], z^i[t] in that order reading them 
off from the top levels of y^[t\. Then, it removes the effect of these signals from y 3 [t] to obtain 
the residual signal 

/ \ 




«i[t + l] +u 2 [t] 
\ Zil [t]- Ul [t-1] J 

This residual signal is multiplied by -1 and shifted upwards (equivalent to a scaling in the 
Gaussian case) and transmitted at time t + 1 as xs[t + 1]. Destination 3 has to wait till at 
least after time t + 1 in order to recover u 2 [t] from the fourth level of its observation at time 
t, namely vi[t + 1] + u 2 [t\. This is because neither u 2 [t] nor vi[t + 1] is available separately 
until time t + 1 when the latter is recovered. The destination then removes the effect of 
this level. This allows it to recover z±i[t] since u\\t — 1] is already recovered. In generalizing 
this example, our achievable scheme will adopt a similar approach as explained in the next 
section. 

The above scheme involved three types of signals. 
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• Public signals. u\ and u 2 in the scheme above are recovered by both the destinations. 
This signal is similar to the public message of Han and Kobayashi's superposition 
scheme for two-user interference channels. 

• Private signals, z^i, z^ 2 , and zyi are recovered only by the destinations to which 
they are intended. This signal is again similar to the private message of Han and 
Kobayashi's scheme. We want to further divide these signals into two types in the 
context of our scheme: 

— I private signals. and z^\t] are recovered by the respective destinations 
on observing y 3 [t] and y^[t] respectively. The destinations remove the effects of 
these signals from the observations in order to prepare the residual signal which 
is transmitted at time t+1. In this sense these signals are treated differently by 
the destinations compared to the signals and zi 2 [t}. 

— I private signals. and z^t], unlike the above | private signals, are recovered 
by the respective destinations with a certain time-lag. 

• Cooperative private signals. v\ and v 2 are also recovered only by the destinations to 
which they are intended. However, their effect at the destination where they could act 
as interference is nulled out by the actions of the other destination. In this sense, these 
signals benefit cooperation. 

In this example, sources made use of the relaying capabilities of destination nodes to 
beamform and null-out part of the interference. This idea has similarities to a technique 
independently arrived at in [8] which the authors call interference neutralization. 

4.2 Example 2 

Consider the symmetric linear deterministic channel with no = 2,nj = l,nc = 3. 




where Uk(T) = Wfc(O) = 0, k 



1,2. The destinations transmit 




which is possible since the destinations receive 



2/3 [*] 



/ u 2 [t-l] 

Ul[t] 

\ z 1 [t} + u 2 [t\ 



) 



and g/4[i] 



«l[t-l] 
u 2 [t] 
z 2 [t)+u 1 [t] 



) 
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Thus, destination 3 now recovers zi[t], U2[t\) : t = 1,2, ... ,T} and destination 4 

22 [t], Ux[t] : t = 1,2, ... ,T} leading to rates Ri = 2,R 2 = 2. Here the destinations 
helped each other decode part of the interference. 

We have two types of signals in this examples. Signals Z\ and z 2 are private signals in that 
they are decoded only by the destination to which it is intended and they did not benefit 
from cooperation. Signals u\ and u 2 constitute a new kind of signal. 

• Cooperative public signals. These signals are decoded by both destinations. Their 
transmission benefited from cooperation. In this example, destination 3 aided destina- 
tion 4 in recovering the signal U\. It should be noted that, if destination 3 at time t, 
instead of sending U\\t — 1], sent an appropriate linear projection of its received vector 
truncated at the top two levels (so as not include any of the private signal in this linear 
projection), the scheme would continue to work. In generalizing this example, our 
achievable scheme will adopt a similar approach. 



5 Coding schemes 

We use two coding schemes to prove the achievablility of our main results. These schemes 
cater to different regimes of the cooperation link. When the cooperation link is weaker than 
the other links, we use a scheme which extends the intuition from Example 1 of the previous 
section. The basic intuition is that sources may make use of the relaying capabilities of 
destination nodes to beamform and null-out part of the interference. When the cooperation 
link is stronger than the direct links, we use a coding scheme similar to Example 2. This is 
a form of compress-and-forward scheme where the destinations quantize their observations 
and convey these to each other over the cooperation link. We roughly sketch the schemes in 
this section and leave the formal proofs to the appendices. In the appendix ([Cjand D), we 
also show that achievability in these two regimes imply achievability for the entire range of 
cooperative link strengths. 
Cooperation link weaker than other links: 

This is a block-Markov coding scheme which generalizes Example 1. The exact details 
are provided in Appendices [C] and |Dj we only provide a rough sketch here in the context 
of the Gaussian channel. For each block-j, the different types of messages, namely, public, 
I private, { private, and cooperative-private messages are coded using independent codebooks. 
For source-fc, where k = 1,2, let us denote these codewords, respectively, by c^, , cf] , 

and c(£, respectively. Source-A; transmits a superposition of the c^ k \ cjzl> cf^ codewords and 
a signal (defined below) which depends on the current and future c Uk codewords, i.e., 
on {c^l '■ * = 3-t 3 + 1> • • • 1 ^} 1 where J is the total number of blocks. 

where will be defined later. Note that f Sk can be thought of as the effect of passing the 
signal c Sk through an anti-causal filter (which acts on blocks rather than individual samples) 
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with transfer function 



1 - AkZ- 1 

Destinations decode in two phases. At the end of the j-th block, destination 3 decodes 
using successive cancellation decoding, the codewords c$, c£p, and in that order while 
treating all the other undecoded codewords and interference as noise. This constitutes the 
first phase of decoding. The residual signal from which the contribution of the decoded 
signals is removed is scaled by a factor A 3 and transmitted as the X 3 signal in block- j + 1. 
Destination 4 also performs its first phase of decoding in a similar manner and obtains its 
transmit signal X 4 for block-j + 1. Assuming that all the decoding in previous blocks were 
successful, the signal at destination 3 in block-j is a linear combination of signals involving 
{< } : z = j - l,j}, {eg}, {eg : z = j - . . . , J}, {eg : % = j,j + 1, . . . , J}, 
{cf n : i=j-l,j}, {c« : * = l,2,...,j}, {eg }, and {c« : i = 1, 2, . . . , j}. Of these, let 



us consider the contribution of c S2 . We first the operation {f}j-i to denote / from which all 
terms which depend on {eg : i = 1, 2, . . . ,j — 1} have removed. For instance, for % > 0, 

{./;:: ; } ; ; = {4^ + 44r +1) + ^c2-*+ a ) + . . . + ^-^} ,_ x 

Then, the contribution of c S2 in the signal received at destination 3 in block-j i^] 

a.s/jp + ^i^/ir 15 + ^ (<? 2 , 3 /ir 2) + ^^ 2>4 /ir 3) ) 

= {92,3^ + 9cA 4 g 2A {/£ L) }. ) + (g c A 4 g c A 3 ) (g 2jZ {ft^}^ + 9cA 4 g 2 , 4 {/£ 3) }. , 

+ (g c A 4 g c A 3 ) 2 (g^ {ft^}^ + 9cA m , 4 {/£ 5 }. ) + . . . 
= (#2,3 + g C A 4 g 2A A 2 ) (l + (g c A 4 g c A 3 )A 2 2 + (^A^) 2 ^ + . . .) /CO 
Hence, if we choose A 2 ,A 4 such that 

#2,3 = -fl'Cfl , 2,4^4^2, 

we can ensure that c S2 causes no interference at destination 3. Similarly, choosing At,A 3 to 
satisfy 

giA = -9c 91,3^.3 At 



ensures that destination 4 receives no interference from c Sl . In appendix D we show that there 
are choices for A's such that these conditions and the power constraints at the transmitters 



2 Note that there are only a finite number of terms since the block indices start from j = 1. 
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can be satisfied in the regime of interest. The upshot of this is that the cooperative private 
messages do not cause interference at the destinations. Appendix [C] employs a similar scheme 
in the context of linear deterministic channels. 

The second phase of decoding is performed after the entire transmission is completed. 
At the end of the transmissions, the destinations have decoded their own public, cooperative 
private, and f private messages for all blocks. They cancel the effects of these messages 
from their observations. From the residual signal they successively decode the interferer's 
public message and their own j private message in that order while treating the remaining 
interference as noise. The power allocations and the rates calculation are deferred to he 
appendices [C] and [DJ 

Cooperation link stronger than direct links: The following theorem generalizes the scheme 
in Example 2. The coding scheme we use is a block-Markov coding scheme which has ele- 
ments of compress-and-forward coding which was originally proposed for relay channels, 
and superposition coding for interference channels jl]. The destinations perform a form of 
backwards decoding [TT] . 

Theorem 3 Given joint distributions Pu^x x Pu 2 ,x 2 Px 3 Px 4 Py 3 \x 1: x 2 ,x 4 Py 4 \x 1: x 2 ,x 3 Pv 3 \y 3 
Pv 4 \y 4 (where Py 3 \x x ,x 2 ,x± and Py 4 \x 1 ,x 2 ,x 4 are defined by the channel) the rate pair (Ri,R 2 ) 
is achievable if there are non-negative ru 1 ,ru 2 ,rx 1 ,Tx 2 ,T 3 ,T4 such that R\ = ru 1 + rx i; 
R2 = r U2 + rx 2 , and 



r x 1 


<I(X 1 


'1 Y 3 \X 4 , Ui, U 2 


), 








ru 2 


< I(U 2 ; 


Y 3 , ^4 X3, X4, 


Ui), 








ru 2 


< I(U 2 - 


^3 -^3, X 4 , Ui 


) + (r 4 


-/(F 4 ;^ 4 |X 3 


X 4 . 


UuU 2 ,Y 3 )), 


rui 


< HUr, 




u 2 ), 








r t/i 


< l(Ur, 


Y 3 \X 3 , x 4 , u 2 


) + (r 4 


-I(Y 4 ;V 4 \X 3 


X 4 . 


Ui,U 2 ,Y 3 )), 


r 4 


</(X 4 


;Y 3 \u u u 2 ), 










ru 2 + r Ux 


< i(u 2 , 


U^YzMlXz, 


X 4 ), 








ru 2 + r Vl 


< i(u 2 , 


U\] Y 3 \X 3 , x 4 


) + (r 4 


-I(Y 4 ;V 4 \X 3 


X 4 . 


Ui,U 2 ,Y 3 )), 


r 4 + r Vl 


</(X 4 


,Ui] Y 3 , Vi\X 3 , 


u 2 ), 








Ta + r Vl 


<I(X 4 


,u i; y 3 \x 3 ,u 2 


) + (u 


-I(Y 4 ;V 4 \X 3 


X 4 . 


Ui,U 2 ,Y 3 )), 


ru 2 + r 4 


< i(u 2 , 


X 4 ; Y 3 , V4\X 3 , 


Ui), 








ru 2 + r 4 


< W 2 , 


X±', ^3 X 3 , Ui 


) + (r 4 


-I(Y 4 ;V 4 \X 3 


x 4 . 


U^U^Y,)), 


r U2 + r 4 + r Vl 


< i(u 2 , 


X 4 , U\\ Y 3 , V4IX3), 








r U2 + r 4 + r Vl 


< i(u 2 , 


X4, Ui, Y 3 \X 3 


) + (r 4 


-I(Y 4 ;V 4 \X 3 


x 4) 


Ui,U 2 ,Y 3 )), 



and the corresponding inequalities with subscripts 1 and 2 exchanged, and 3 replaced with 4- 

The theorem is proved in Appendix |Aj A rough interpretation follows. The auxiliary 
random variables and the information associated with them are described below: 

• Cooperative public messages. U\ and U 2 carry the cooperative public messages. These 
are decoded by both destinations with help from each other as will become evident. 
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• Private messages. The random variables X\ conditioned on U\ and X2 conditioned on 
U 2 carry the private messages. 

• Quantized observations at the destinations. The destinations quantize their observa- 
tions over each block. The test channel for the quantizer employed by destination 3 
is PV3IV3. Similarly, destination 4 quantizes its observation over a block using the test 
channel Pv 4 \y 4 - 

• Messages from destinations to each other. The quantization codebooks are binned and 
the bin-index of the quantized codewords are conveyed by the destinations to each 
other in the next block. Destination 3 sends the bin-index of its quantized codeword 
to destination 4 in the next block using X 3 . Similarly destination 4 quantizes its 
observation over a block and conveys the bin-index to destination 3 in the next block 
using X4. 

The destinations start decoding from the last block and proceed backwards. For each 
block, destination 3 recovers (i) the two cooperative public messages for the current block, 
(ii) its private message for the current block and (iii) the message from destination 4 which 
conveys the bin-index of the quantized codeword at destination 4 for the previous block. In 
performing this decoding step, besides its observation for the current block, destination 3 
may rely on the bin-index of the quantized codeword at destination 4 for the current block 
since this was recovered in the previous decoding step. This can be done by the destination 
jointly decoding the following: (i) the two cooperative public messages for the current block, 
(ii) its private message for the current block and (iii) the message from destination 4 which 
conveys the bin-index of the quantized codeword at destination 4 for the previous block, 
and (iv) the quantized codeword at destination 4 for the current block. Destination 3 makes 
use of its observation for the current block and the bin-index of the quantized codeword at 
destination 4 for the current block. The private message from the interfering source is treated 
as noise. Decoding at destination 4 also proceeds similarly. 



As explained in detail in Appendices [C] and D where we prove the achievability part of 
our main results, this scheme is useful in the regime where the cooperative link is stronger 
than both the direct links from the sources to their respective destinations. In applying 
this scheme, we choose the power levels for the cooperative public and private signals in a 
manner similar to [2]. The private signals have a power level which ensures that they appear 
at or below the noise-level at the destinations where they act as interference. The quantizer 
test-channel we choose for our purposes is as follows: At destination 3, the quantization- 
noise level is equal to the power level at which the private signal from source 1 is received 
at destination 3. The intuition is that since destination 4 is not interested in decoding this 
private signal from source 1 and treats it as noise, quantizing the observation at destination 3 
any finer than this will not help the joint decoding significantly. In fact, quantizing more 
finely could result in inferior performance since the destinations have to code the messages 
for each other at higher rates without producing significant benefits and this potentially 
results in overall lower rates for the other messages. 

The decoding scheme in Theorem [3] deviates slightly from the earlier description. This is 
done primarily to simplify the evaluation of the achievable sum-rate for the Gaussian case. 
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Instead of decoding the two cooperative public messages, the private message, the message 
from the other receiver, and the quantized codeword at the other destination for the current 
block, the destinations initially decode only (i) the two cooperative public messages, (ii) the 
message from the other destination, and (iii) the quantized codeword at the other destination 
for the current block. This is done treating both the private messages as noise. Once the 
above messages are recovered, (i) and (ii) are stripped off from the received signal and the 
private message is decoded from the residual signal. While this decoding scheme, in general, 
could lead to an inferior rate-region compared to the one described earlier, it is sufficient to 
obtain the achievability of sum-rate for the linear deterministic and the Gaussian cases (up to 
a constant gap for the Gaussian). For completeness, below we state a generic achievablility 
theorem which implements the joint decoding of the earlier description. We sketch a proof 
in Appendix [Bj However, we do not use this scheme in proving Theorems [T] and [2| 

Theorem 4 Given joint distributions p Ul>Xl Pu 2 ,x 2 Px 3 Px 4 Py 3 \x u x 2 ,x 4 Py 4 \x u x 2 ,x 3 Pv 3 \y 3 
Pv 4 \y 4 (where Py 3 \x 1 ,x 2 ,x 4 and Py 4 \x 1 ,x 2 ,x 4 are defined by the channel) the rate pair (Ri,R 2 ) 
is achievable if there are non-negative ru 1 ,ru 2 ,r Xl ,rx 2 ,r 3 ,r 4 such that R± = ru 1 + rx 1 , 
R2 = r U2 + r X2 , and 

r Xl <I(Xi, Y 3 ,V 4 \X 3 , X 4 ,U h U 2 ), 
rx^IiX^X^X^Ui) 

+ (r 4 - /(y 4 ; V 4 \X 3 , X 4 , X x , U 2 , Y 3 ) + I(X i; V 4 )), 
r 4 <I(X 4 ;Y 3 \X 3 ,X u U 2 ), 
r U2 + r Xl < I(U 2 , X i; Y 3 , V 4 \X 3 , X 4 , U 1 ), 
ru 2 + r Xl < I(U 2 , X i; Y 3 \X 3 , X 4 , U x ) 

+ (r 4 - I(Y 4 ; V 4 \X 3 , X 4 , X u U 2 , Y 3 ) + I(U 2 , X i; V 4 )), 
r m + r Xl < HXu Y 3 , V 4 \X 3 , X 4 , U 2 ), 
r Ul +r Xl <I(X 1 ;Y 3 \X 3 ,X 4 ,U 2 ) 

+ (r 4 - I(Y 4 ; V 4 \X 3 , X 4 , X u U 2 , Y 3 ) + I(X i; V 4 )), 
r, + r Xl </(X 4 ,X i; Y 3 ,V 4 \X 3 ,U 2 ), 
rA + r Xl <I{X 4 ,X l -Y 3 \X 3 ,U 2 ) 

+ (r 4 - I(Y 4 ; V 4 \X 3 , X 4 , X u U 2 , Y 3 ) + I{X X - V 4 )), 
ru 2 +r 4 < I(U 2 , X 4 ; Y 3 , V 4 \X 3 , X x ), 

r [ / 2 +r 4 </(C/ 2) X4;y 3 |^3 ) ^i) 

+ (r 4 - J(Y 4 ; V 4 \X 3 , X 4 , X u U 2 , Y 3 ) + I(U 2 ; V 4 )), 
ru 2 + r Vl + r Xl < I(U 2 , X x ; Y 3 , V 4 \X 3 , X 4 ), 
ru 2 + r Vl + r Xl < I(U 2 , X x \ Y 3 \X 3 , X 4 ) 

+ (r 4 - I(Y 4 ; V 4 \X 3 , X 4 , X u U 2 , Y 3 ) + I(X U U 2 ; V 4 )), 
r 4 + r Vl + r Xx < I(X 4 , X i; Y 3 , V 4 \X 3 , U 2 ), 
r 4 + r Vl + r Xl < I(X 4 , X,; Y 3 \X 3 , U 2 ) 

+ (r 4 - I(Y 4 ; V 4 \X 3 , X 4 , X u U 2 , Y 3 ) + I{X X - V 4 )), 
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r U2 + r 4 + r Xl < I{U 2 , X 4 , X r] Y 3 , V 4 \X 3 , U x ), 
r U2 + r 4 + r Xl < I(U 2 , X 4 , X i; Y 3 \X 3 , U x ) 

+ (r 4 - I(Y 4 ; V 4 \X 3 , X 4 , X u U 2 , Y 3 ) + I(X U U 2 ; V 4 )), 
r U2 + r 4 + r Vl + r Xl < I(U 2 , X 4 , X x ; Y 3 , V 4 \X 3 ), 
r U2 +r 4 + r Vl + r Xl < I(U 2 , X 4 , X i; Y 3 \X 3 ) 

+ (r 4 - I(Y 4 ; V 4 \X 3 , X 4 , X u U 2 , Y 3 ) + I(X U U 2 ; V 4 )), 

and the corresponding inequalities with subscripts 1 and 2 exchanged, and 3 replaced with 4- 

6 Upperbounds 

The upperbounds of Theorems [T] and [2] are derived in appendix [Ej The key ideas behind the 
upperbounds are as follows: 

Upperbound 1: We simulate two dummy channels which are independent realizations of the 
original channel. In both channels, the same codebooks as in the original are used. In the 
first dummy channel, the message M\ of sender 1 is replaced by a dummy message random 
variable M[ which is also uniformly distributed over the alphabet Ai, but is independent 
of both Mi and M 2 . Similarly, in the second dummy channel the message M 2 is replaced 
by a dummy message M' 2 ' . A genie provides destination 3 with M% and a certain signal 
(g\ 4 {X^) + g 3)4 {X^)) from the second dummy channel, and destination 4 with the symmetric 
counterparts from the first dummy channel. Applying Fano's inequality and conditions 
implied by the causality conditions on the sources, we derive upperbounds which imply (|6]) 
and <Q. ' 

Upperbound 2 and 3: To show upperbound 2, we consider a genie which provides g 23 {X 2 ) 
and M\ to destination 4 and nothing at all to destination 3. Using Fano's inequality and 
using the causality conditions obeyed by the sources, we derive upperbounds which imply 
@-(j§ and (§-©. 

Upperbound 4 : This is a simple cut-set upperbound with nodes 1 and 3 on one side of the 
cut and nodes 2 and 4 on the other side. 

Upperbound 5: This is also a cut-set bound. The sources are on one side of the cut and the 
destinations on the other. 

7 Discussion 

The gap in Theorem [2] can be easily improved by considering more elaborate schemes and 
further tightening the upperbound. We mention a couple of ideas to illustrate how this could 
be achieved. However, computing the best possible gap appears to be challenging and we do 
not pursue it here. 

Even with the schemes we presented in the last section, we picked potentially sub-optimal 
power allocations for the different messages involved in order to simplify the calculations. 
Improvements in the gap can be achieved in specific instances simply by optimizing over 
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these power allocations. But still further improvements can be achieved by considering 
other schemes. For instance, consider the case of a channel with a direct links which are 
weak compared to the interfering and cooperative links. Incorporating a form of decode-and- 
forward strategy can improve performance. To see this, let us consider this extreme case: 
both direct links are absent 

91,3 = 92,4 = 0, 

the interfering links have the same strength 

\9l,4\ = 102,31 = \gi\, 
and the cooperative links are such that the following condition is satisfied 

(i + \gc\ 2 ) 2 <(i + \gi\ 2 + \gc\ 2 ). 

Then, we can show that the sum-capacity is achieved by a simple decode-and-forward scheme. 
Both destinations decode the message from their interfering sources treating the signal in 
the cooperative-link as noise, and then in the next block they forward this decoded message 
to the other source over the cooperative link. Since the interference is decoded off first, the 
signal over the cooperative link can be decoded without any interference. The resulting rate, 
under the condition on the channel strengths mentioned above, is 

21og(l + |< ?c | 2 ), 

which is also what upperbound ^ works out to. However, no choice of power allocations in 
Theorems [3] or [4] can achieve this. This can be easily remedied by extending those schemes 
by incorporating a partial-decode-and-forward component. However, we do not pursue this 
direction since the gains are at most a constant and computing such gains to get an improved 
uniform bound appears to be involved. 

The upperbounds could also be improved. Modifying the correlation of the Gaussian 
noise processes in the additional signals we provide to the destinations can lead to tigher 
upperbounds 1, 2, and 3. Also, the correlation between the input signals can be explicitly 
accounted for instead of assuming the worst-case correlation at different stages as we do. 
Upperbound 5 can be easily improved by choosing the optimal input covariance matrix. 



A Proof of Theorem [3 

We present a block-Markov scheme with backwards decoding. Given pu^,x Y Pu 2 ,x 2 Px 3 Px 4 
Py 3 \x u x 2 ,x 4 Py 4 \x x ,x 2 ,x 3 Pv 3 \y 3 Pv A \Yi (where p Y3 \Xi,x 2 ,x 4 and p YA \x x ,x 2 ,x A are defined by the 
channel), we construct the following blocklength-T codebooks: 

• U codebooks: For k — 1, 2, we create [/^-codebooks Cu k °f s i ze 2 T(rv fc~ 3e ) respectively, 
by choosing elements independently according to pu k ■ These codewords will be denoted 
by c Uk {m Uk ) where m Uk e{l,..., 2 T(rc/ ^ 3e) }. 
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• X\ and X 2 codebooks: For each codeword cu k (mu k ), we create a Xfc-codebook C Xk ( m u k ) 
of size 2 T(j ' x k~' s ^ by choosing elements i.i.d. according to px k \u k (-\ u k) by setting to 
be the respective element of the cu k {mjj k ) codeword. We denote these codewords by 
Cx k (m Xk ,m Uk ), where m Xk G {1,.. . , 2 T(rx fc~ 3e) }. 

• X 3 and X 4 codebooks: For k = 3,4, we create X fc -codebooks Cx fc of size 2 T ^ rfc_ ^ by 
choosing the elements i.i.d. according to p Xk . These codewords will be denoted by 
Cx k {rn Xk ) where m Xk G {1, . . . , 2 r(rfc_e) }. 

• Vfc codebooks: For k = 3, 4, we create V*. codebooks Cv*. of size 2 T< - / ( Yfc;V ' fc ) +,E - ) by choosing 
the elements i.i.d. according to the induced marginal distributions py k . We bin these 
codebooks such that the number of bins is 2 T( - rk ~ e \ The codewords will be denoted by 
Cv k {bv k , iv k ) where the bin-indices are denoted by by k G {1, . . . ,2 T ^ rfc ~^}, and within 
each bin, the index of the codewords are denoted by iy k G {1, . . . , 2 T ^ I ^ Yk]Vk ^~ rk+2 ^} . 

Encoding at the sources: For block-j, j — 1, 2, . . . , J — 1, the encoders at the sources choose 
the codewords cu k (mu k {j)), and c Xk (m Xk (j),m Uk (j)). The X-codewords are transmitted. 
For the last block J, we set m,u x (J) = m Xl (J) = mu 2 (J) = m x . 2 (J) = 1. 

Encoding at the destinations: At the end of block-j, j = 1, 2, . . . , J — 1, the destination 3 
quantizes its (T-length) block of observations Yg T using the V 3 codebook by finding a code- 
word cv 3 (bv 3 (j), iv 3 (j)) which is jointly (strongly) typicaj^] [121 Chapter 13] with its observa- 
tion. If no such codeword exists, we will say that "encoding failed at block-j" and declare 
an error. However, encoding succeeds with high probability since the V3 codebook has rate 
/(V3; I3) [TJ]. Then destination 3 sets mx 3 (j + 1) = &v 3 (j) and for block-j + 1, destination 3 
sends c X3 {m x . A (j + 1)). The encoding at destination 4 proceeds similarly. 

Decoding at the destinations: Destinations perform backwards decoding [TTJ. We will assume 
that before destination 3 processes block-j, it has already successfully decoded m Xi (j + 1). 
This is true with high probabilit}]^] for j = J if 

r 4 <I(X 4 ;Y 3 \X 1 ,X 2 ). 

For each j = 1, 2, . . . , J — 1, we will ensure that from block-j, destination 3 decodes 
m x 4 (j) successfully with high probability thereby ensuring that the above assumption holds 
true. Assuming that m Xi (j + 1), which is equal to bv 4 (j), is available at destination 3, we will 
ensure that from the observation Y 3 made by destination 3 in block-j, the messages mjj^j), 
m Xl (j), and m Xi (j) can be successfully decoded with high probability. The decoding will 
proceed in two steps. In the first step, destination 3 will attempt to decode the messages 
m uAj) an d m x 4 (j) along with the message mu 2 (j)- Then, conditioned on these messages, it 
will try to decode the message m Xl (j). Concretely, in the first step the decoder looks for a 
unique collection of codewords such that they are jointly typical with its observation Kj T (j) 

3 In the sequel, we denote the set of strongly 5- typical sequences by T^. 
4 i.e., with probability approaching 1 as the blocklcngth T goes to 00. 
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and the information it already has, namely mx 3 {j) and bv 4 {j)- In other words, destination 3 
searches for a unique (^^(j), m^ 2 (j% mxtC?)) sucn ^ na ^ 

{c Vl (rhu, ( j ) ) , cc/ 2 (rhu 2 (J)), c Xi {rh Xi ( j ) ) , c X3 (% 3 ( j ) ) , cy 4 (6y 4 ( 3 ),iv 4 (j)), Y I (j)) e T T 5 , 

for some zvi(j). We will argue below that this decoding succeeds, z.e., (m^fj), m;y 2 (j), rhx 4 (j)) = 
( m Ui(j), m U2(.j)i m x 4 (j)) with high probability if the following conditions are met. 

r C / 2 </(^ 2 ;F3,V r 4|X 3 ,X4,f/ 1 ), 

rts, < 7(c/ 2 ; ^1^3, x 4) U x ) + (r 4 - /(y 4l V,\X 3 , X 4 , £/ x , C/ 2 , y 3 )), 
r Ul <I(U 1 ;Y 3 ,V i \X 3 ,X^U 2 ), 

rv x < i{Ux\ y 3 |x 3 , X 4 , C/ 2 ) + (r 4 - J(y 4 ; y 4 |X 3 , x 4 , c/ ls c/ 2) y 3 )), 

rc/ 2 + 7V a < /(C^2, f/i; ^IXa, X 4 ), 

rt/ 2 + < i(u 2 , u x - y 3 |x 3 , x 4 ) + (r 4 - /(y 4 ; y 4 |x 3 , x 4 , u x , u 2 , y 3 )), 
r 4 + r^ <7(x 4 ,^ i; y 3 ,y 4 |x 3 ,f/ 2 ), 

r 4 + < 7(X 4 , Ur, Y 3 \X 3 , U 2 ) + (r 4 - 7(y 4 ; y 4 |X 3 , X 4 , U 2 , Y 3 )), 
r l / 2 +r 4 <7(f/ 2 ,X 4 ;y 3 ,y 4 |X 3 ,f/ 1 ), 

r % + r 4 < I(U 2 , X 4 ; Y 3 \X 3 , U t ) + (r 4 - 7(y 4 ; V 4 |X 3 , X 4 , U lt U 2 , Y 3 )), 
r U2 + r 4 + r Vl < I(U 2 , X 4 , C/ i; Y 3 , V 4 \X 3 ), 

r U2 + r 4 + < I(U 2 , X 4 , tf l5 y 3 |X 3 ) + (r 4 - 7(y 4 ; y 4 |X 3 , X 4 , U x , U 2 , Y 3 )). 

In the second step, destination 3 decodes mx^j) using its observation Y 3 T (j) and what it 
decoded in the previous step, namely, rhuxij), ™u 2 (.j)i an d ^x 4 (j)- It looks for a unique 
7hx 1 (j) such that 

(c Xl (m Xl (j)), c Ux (rhu, (j)), c<j 2 (m U2 (j)), c Xi (% 4 ( j ) ) , Y 3 (j')) 6 Ty. 

Assuming that the first step succeeded, it can be shown that the second step succeeds in 
decoding the correct message with a high probability if 

r Xl <7(X 1 ;y 3 |C/ 1 ,[/ 2) X 4 ). 

We will now argue that the probability of error in the first step is vanishingly small. We 
first note that the correct choice of messages will result in a jointly typical set of codewords 
with high probability, i.e., when T — > 00, 

^(^(^(^W^ma,^ e T^j -> 1. 

This is essentially a statement of Markov Lemma [HI Lemma 4.1] (also see [151 Corol- 
lary 3.2.3.1]). We need to show that the probability of the event E that there is some 
(m !7l (j) ) m £ / 2 0'),TOx4 0')) 7^ (m Ul (3),m U2 (j),m X4 (j)) and some i Va such that 

(c&i (mu^j)), c U2 (m U2 (j)), c Xi {m Xi {j)), c Xs (m Xs (j ) ) , C y 4 (6y 4 ( j ) , i y 4 (j ) ) , Y 3 T (j ) ) G 7" T 5 
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is small. This event is the union of the following two events: (1) where %y 4 takes on its 
correct value iy 4 , and (2) where iy 4 ^ %y 4 . Further, each of these events are unions of events 
where some or none (but not all) of the messages take on their correct value. We apply 
union bound to upperbound P(E). To illustrate, let us consider two events: 

Ei, 2 ,4 = {fhuti) ^ "H/iO')>"i^aO') ^ m u 2 {j),m X4 {j) ^ ™x 4 (j),iv 4 (j) = iv 4 {j)} > 
E i, 2 ,4 = {™uAj) + m uA3),rh U2 {j) ^ m U2 {j),m Xi {j) ^ m X4 {j),iv 4 {j) ^ i v JJ)} ■ 

We have 

P(El,2,4) 

mil! + rnu^j), 
rh U2 / m U2 (j), 
m X4 + m X4 (j) 

< 2T(ru 1 +ru 2 +r4-7e)2T(-I(U 1 ,U 2 ,X 4 ;X 3 ,V 4 ,Y 3 )+5) 
= 2T(r Ul +r U2 +r 4 -I(U 1 ,U 2 ,X 4 ;V 4 ,Y 3 \X 3 )-7e+S) 

If the rates satisfy the condition 

ri/i +ru 2 +n < I(U 1 ,U 2 ,X 4 ;V 4 ,Y 3 \X 3 ), 
the probability of the error event E 12) 4 can be made vanishingly small. Similarly, 

S P ((ct/^mc/J, cu 2 (m U2 ), cx 4 {m X4 ), c X3 (m X3 (j)), c V4 {b V4 {j),i V4 ), Y 3 T (j)) G T T 5 ) 

m U2 / m U2 (j), 
mx 4 / mx 4 (j ), 
iv 4 + iv 4 {j) 

_ 2T{r Ul +r U2 +r 4 +(I(Y 4 -y 4 )~r 4 )^e)2T{~I{U 1 ,U2,X 4 y 4 ;X 3 ,Y 3 )+S) 

_ 2T((r Ul +r U2 +r 4 -I(Ui,U 2 ,X 4 ;X 3 X3))-(r 4 -I(V 4 ;Y 4 )+I(V 4 -,X 3 ,Y 3 \Ui,U 2 ,X 4 ))-5e+S) 

To drive the probability of this error event (E* 24 ) to zero, it is enough to ensure that 
r Vl + r U2 + r 4 < I(U 1} U 2 , X 4 ; X 3 , Y 3 ) + (r 4 - I(V 4 ; Y 4 ) + I(V 4 ; X 3 , Y 3 \U U U 2 , X 4 )). 
Note that 

I(V 4 ; Y 4 ) - I(V 4 ; X 3 , Y 3 \U 1} U 2 , X 4 )) = I(V 4 ; Y 4 , U u U 2 , X 4 , X 3 , Y 3 ) - I(V 4 ; X 3 , Y 3 \U U U 2 , X 4 )) 

= I(V 4 ; U u U 2 ,X 4 ) + I(V 4 ; Y 4 \X 3) X 4) U u U 2 , Y 3 ) 
>I(V 4 ;Y 4 \X 3: X 4: U U U 2: Y 3 ), 



19 



where the first equality follows from the fact that V4 — I4 — (Ui, U2, X 4 , X 3 , 13) is a Markov 
chain. Hence, P(E^ 24 ) can be made small if 

ru, + r U2 + r 4 < I{U X , U 2 , X 4 ; Y 3 \X 3 ) + (r 4 - I(V 4 ; Y 4 \X 3 , X 4 , U 1: U 2 , Y 3 )). 

Similarly, considering the other possible error events results in the rest of the conditions. 
A similar set of conditions ensure success of decoding at destination 4. If decoding fails 
for block-j for either of the destinations, we will say that "decoding failed at block-j" and 
declare an error. 

Overall, an error results if for at least one block-j, either encoding fails or decoding fails. 
Since there are a finite number J of blocks, by union bound, the above discussion implies that 
the probability of error goes to as the blocklength goes to 00 when the above conditions 
are met. This completes the random coding argument. 



B Proof sketch of Theorem HI 

The codebook construction and encoding at the sources and destinations are identical to 
the one in Appendix |Aj The only difference is in how the messages are decoded by the 
destinations. The destinations again follow a backwards decoding procedure similar to the 
one there. However, instead of carrying it out in two steps, the destinations attempt to 
decode the same set of codewords as there, but in a single step. In particular, destination 3 
while decoding block-j looks for a unique set of (rhu^j), Thu 2 (j), rh X4 (j), mxAj)) sucn that 

(cu, {rh Vl ( j ) ) , c U2 (m U2 ( j ) ) , c Xi (% 4 ( j ) ) , c Xl {rh Ux ( j ) ) , c Xs (m X3 ( j ) ) , c Va (b Vi ( j ) , i Vi ( j ) ) , Y 3 ( j ) ) G T 7 

for some iv 4 (j)- Note that, as in Appendix [A in performing this decoding step, destina- 
tions 3 makes uses of the bin-index iv 4 (j) which was recovered from processing block-j + 1. 
The conditions on the rates in Theorem [4] ensure that the probability of all relevant error 
events are small for sufficiently large values of T. The analysis is along the same lines as in 
Appendix [A] and is omitted. 
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C Proof of the achievability of Theorem [T] 

If we fix ni )3 , ni j4 , n 2 ,3, and 712,4, and consider the w^'s in ([lJ-Q as functions of nc, the sum- 
rate expression in Theorem [l] (as a function of nc) breaks up into three natural regimes. We 
use different strategies to achieve the sum-capacity in different regimes. The regimes are: 

(i) n c < n min = min^i.s, ^1,4, ""-2,3, n 2,-i)- It can be shown that for ric > n min , 

ui{n c ) > min(u2{nc),u 3 (nc),U4{nc),u 5 ). 

Hence, we need consider u\ only in the regime nc < "ftmin- Moreover, in this regime, 
U2{nc) through u 4 {nc) are constants {i.e., they do not depend on nc and their val- 
ues are the same as when nc = 0). Since Ui(nc) is monotonically increasing in nc, this 
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means that we need to employ cooperation only when iti(O) < min(w 2 (0), «3(0), ^4(0), w 5 ), 
i.e., when 

max(ra lj3 - n M , n 2j3 ) + max(n 2 , 4 - 77,1,4, 711,4) 

< min ^max(ni i3 ,n 2i3 ) + (max(n 2i4 , n 2 , 3 ) - n 2>3 ) , 

max(n 2i4 , ni, 4 ) + (max(ni, 3 , n li4 ) - ni, 4 ) , "1,3 + n 2 ,^j . (11) 

When the above condition is not true, the sum-rate expression reduces to the sum- 
capacity without cooperation. 

(ii) n min < nc < min(n 13 , n 2 4 ). In this regime, we can observe that the sum-rate expres- 
sion takes on a constant value since u 2 (nc), w 3 ("c), and w 4 (n c ) are still constants. 
Hence, the achievability here is implied by the achievability in regime (i). 

(iii) min(ni j3 , n 2;4 ) < nc- In this regime, we use Theorem [3] 
For integer q satisfying 1 < q < n, we define 

T q = {xe¥ n :x t = 0,i<q}, 

i.e., all vectors in F n such that their components in the range 1, . . . , q are zeros. We take the 
indexing of the elements of vectors to start from the top as usual. For example, for binary 
field and n = 4, 
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Regime (1): n c < n i:j , i G {1,2}, j G {3,4}. 
First of all, we note that if 

"i,4 + "2,3 > ni )3 + n c and n M + n 2j3 > n 2A + n c , 

then, 

Ul {n c ) = tti(O). 

Putting this together with the fact that M 2 (nc), w 3 (nc), and ii 4 (nc) are independent of nc in 
regime (i) (as discussed above), we may conclude that it is enough to show acheivability under 
no cooperative link {i.e., under nc = 0). But this achievability is already known (see |10j . 
for instance). Hence, we will assume that at least one of the following two conditions is true. 

"1,4 + n 2 ,3 > ni )3 + n c and 77,1,4 + n 2j3 > n 2A + n c . 

We will first consider ) where the following conditions are satisfied. 

"a,4 + "-2,3 < "i,3 + nc and 771,4 + n 2j3 < n 2)4 + n c . 
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Following that, we will consider case (b) where 



^1,4 + ^2,3 < ^1,3 + n c and ™1,4 + ™2,3 > n 2,4 + n C - 
By symmetry, this would also cover the third possibility of 

^i,4 + n 2 , 3 > n h3 + n c and n M + n 2j3 < ^2,4 + 

For case (a), let us consider the following block-Markov scheme with superposition coding. 
Let Uk, Sk, -Zffc, k — 1, 2 be independent auxiliary random variables with marginal dis- 
tributions Pu k )Ps k )Pz }k )Pz ik - The alphabet for these random variables is F n . Corresponding 
to these random variables, random codebooks of blocklength-T and rates ru k ,rs k ,rz 1k ,rz lk , 
respectively, are defined as usual. For instance, the /Ji-codebook, denoted by C\j x , is of size 
2T(r Ul -e) j g g enera ted by choosing the T elements of each of the codewords independently ac- 
cording to pu x . These codewords will be denoted by Qy^m^J where e {1, . . . , 2 T ^ ru i~^}. 
The blocks will be indexed by j = 1, 2, . . . , J. The message transmitted by source 1 using 
the ^i-codebook in block- j will be denoted by m^ij), and the corresponding codeword by 
CjjI = c u 1 { ra u 1 {j))- For block-j, sources transmit the following blocklength-T vectors 

vti) _ JJ) I Si) I r U) I Ai) 



where 

iS^cg + A^ + .-. + A^cg), 

it ) = c g+A2 C r i) +---+A 2 7 -^, 

where Ai and A 2 are matrices given below. The addition is vector addition. 

— gni,3+nc-ni,4-Ti2,3 ^ 2 _ gn2,4+nc-ni,4-n2,3 

In the sequel we will ensure that the rates of the codebooks are such that from observing 
the j-th block observed by destination 3, it (destination 3) can decode with a high 
probability of success the codewords c[^, c^, and c^, for all j. Similarly, we will make 

sure that destination 4 will successfully decode c^ 2 , Cg 2 , and c^ 2 from Y± \ Then, the 
destinations will transmit, respectively, for j — 1,2, . . . , J — 1, 



A 3 - A 3 1/3 _ ^1,3 + C Sl + C^J - bcA^i^ [C^ + C z ^ 

a 4 - a 4 - u 2j4 + c S2 + c Un j - b c A 3 b 2 ,3 [c U2 + c Zn ) J , 

where, is a short-hand notation for S n ~ nk ^ k 2, and G^ for S n_nc . Also, A 3 and A 4 

are matrices defined below. 

A 4 = _s-("- ni . 4 ), 
A 3 = -S^™"™ 2 ^. 
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The choices for the distributions of the auxiliary random variables used to create the code- 
books will be taken up in the sequel. 

With these, the received signals at the destinations are 

Y 3 U) = ^\c Vl + c Zn ) + G 1>s (/^) + grJ>\c Zll ) + G 2 , 3 (cg + c%) + ^\c Zl2 ), 
Y} j) = 92A U) (c U2 + c Z]2 ) + G 2 M { £) + &A {j) (c Zl2 ) + G M (cg + c%) + gtf»(c Zll ), 

where the functions are as defined below. Note that Y 3 does not have any terms which depend 
on ^-codewords (and similarly, Y4 does not involve any terms containing S^-codewords). 
This was achieved by the appropriate choices above for Ai and A 4 (respectively, A 2 and 
A 3 ). 

g^Xcu, + c Z]1 ) = G,Ml + c%) + G c A 4 G 1 , 4 (c^ 1) + c^ 1} ), 

9&Xcz»)= E (G c A 4 G c A 3 ) i ?G 1) 3cg; i 
ie{j,j-2,...,i} 

+ E (G c A 4 G c A 3 ) 2 ^ 1 G c A 4 G 1 , 4 cg i , 

ie{j-l,j-3,...,l} 

9^3 U) (c Zl2 )= £ (G C A 4 G C A 3 )^G 2 ,3C« 

ie{j,j-2,...,i} 

+ ]T (GcA 4 GcA 3 ) t ^GcA 4 G 2 , 4C « 2 , 

ie{j-l,j-3,...,l} 

and the functions g~2~A^\cu 2 + c z n ), 92^\cz i2 ), and gi^^\c Zll ) are defined similarly. Note 
that, as before, G fcljfc2 is a short-hand notation for S n ~ nfe i> fc 2, and G c for S n ~ n °. 

As mentioned earlier, destinations perform decoding in two phases. At the end of every 
block j, the destinations decode the off , c<^ and c~ z intended for them (in that order). We 
call this phase 1 decoding. At the end of block- J, the decoders perform a phase 2 decoding 
where it decodes the following codewords for all blocks, i.e., for each j = 1,2, . . . , J, the 
destinations decode Cjp intended for the other user and c z j intended for itself (in that 
order). In both of the phases, the decodings are performed in the order mentioned above 
treating all the undecoded codewords and other interference as noise. Below, we will specify 
the distributions employed and evaluate the conditions on the rates to ensure successful 
decoding. This will establish achievability for regime (i). 

The auxiliary random variables Ui, S±, Z^, and Z^, respectively, are uniformly dis- 
tributed over F n , jF rai4 _ nc , jF ni4 , and jF ni 3+nc _„ 2 3 . Destination 3 transmits 

X® = A* (Y® -G^ + $ + 

= A 3 (g^ U \c Zll ) + G 2 , 3 (cg + c%) + gXs {i) (c Zl2 )) 



23 



The rates supported by the above scheme for source 1 are given by the following set of 
conditions. 

rui < ["1,4 - "c]> 
rui < "c, 

rsi <n c - ["2,3 - ("1,3 - "1,4)]+, 
r Zn < ["1,3 - "1,4 - "2,3]+, 
rz u < [n 2 ,3 -n c ]+. 

The first constraint on rjj 1 comes from the phase 1 decoding at destination 3, while the 
second condition is from the phase 2 decoding at destination 4. A similar set of constraints 
apply for the rates achievable by source 2. 

Combining all these, an achievable sum-rate is given by 

R sum = max(ni )3 - n M + "c, "1,3 - n c ) + max(n 2 , 4 - "2,3 + "c, "2,4 - "c)- 

This, combined with the fact that the achievability of a given sum-rate at a lower value 
of nc implies its achievability for all larger values of nc provided the rest of the channel 
coefficients remain the same allows us to conclude that the minimum of the following three 
terms is achievable. 

"i,3 - "1,4 + n c + " 2 , 4 - n 2 , 3 + "c, 
"1,3 + "2,4 - "1,4, and 

"2,4 + "1,3 - "2,3- 

Under case (a), it is easy to verify that this is precisely what the upperbound evaluates to. 
Hence, we have shown achievability for case (a). 
Let us now consider case (b) where 

"1,4 + "2,3 < "1,3 + "c and n M + "2,3 > "2,4 + "c- 

The achievable strategy we use for this case involves source 1 transmitting according to a 
scheme similar to the one above while source 2 employs a superposition coding scheme similar 
to that of Han and Kobayashi for the interference channel without a cooperative link. In 
particular, only node 3 uses its transmission capabilities. 

The codebooks and the choice of distributions for source 1 are exactly as above, except 
for the choice of rates which will be presented in the sequel. Source 2 uses only the following 
codebooks: U 2 and Z± 2 . Moreover, Z^ 2 is now uniformly distributed over J„ 2 3 . Exactly as 
in the earlier scheme, destination 3 performs a two-phase decoding and transmits a shifted 
version of the residual signals after the first phase of decoding of the previous block. The 
shift matrix A3 is the same as above. Destination 4, on the other hand, performs only a 
single phase of decoding where U 2 , U\ and Z^ 2 codewords are decoded. As mentioned earlier, 
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destination 4 does not transmit anything, i.e., A 4 = 0. The received signals can be seen to 
be 

F 3 (i) = G 1|8 (cg + c% + + c%) + G 2 , 3 (cg + c%), 

n (i) = G 2 , 4 (cg + c%) + G c A 3 G 2 , 3 (c^ 1) + cg- 1} ) + G li4 (cg + c j£) + ^(czj, 
where, unlike earlier, 

^S w (c % ) = G 1A c% + G r A :! G|. ;i '-/\ ' • 

Note that, again the appropriate choice of A x and A 3 has ensured that no contribution from 
the Si codeword is observed at destination 4. 

Decoding at destination 3 proceeds as in the above scheme. On the other hand, destina- 
tion 4 decodes, at the end of each block, (i) first, the U 2 and U\ codewords jointly treating all 
other signals and interference as noise, and then from the residual signal (ii) Z^ 2 codeword 
treating interference as noise. The conditions on the rates for successful decoding are given 
below. 

rui < [ni,4 - n c ], 
ru 2 < nc, 

rsi <n c - [712,3 - ("1,3 - 711,4)]+, 
rz n < [n 1)3 - 7ii )4 - n 2)3 ]+, 
r Zll < [n 2 ,s - n c }+, 

r U2 < min(ra 2 ,3, t* 2 , 4 ), 

rUr < [ni,4 - [t*2,4 - 7l 2 ,3]+], 

ru 2 + 7-c/i < max(n 2j4 , 711,4) - [n 2 ,4 - 7*2,3] + , 
r Zl2 < [n 2 , 4 - t* 2 , 3 ] + - 

where the first five conditions ensure successful decoding at destination 3 and the rest of 
the three conditions does the same for decoding at destination 4. Upon simplifying, we may 
conclude that a sum-rate equal to the minimum of the following terms is achievable 

7*1,3 + [t*2,4 - 722,3] + , 

7*1,3 — 7ii, 4 + max(rii j4 , n 2)4 ), and 

7*1,3 + Tic- 
It is easy to check that this is what our upperbound evaluates to under case (b). Thus, we 
have also proved achievability under case (b). 

Regime (Hi): min(ni >3 , n 2)4 ) < nc- We employ Theorem [3] with the following choices for 
PUuXi, Pu 2 ,x 2 , Px 3 , Px 4 , Pv 3 \y 3 , and p Vi \Y 4 - Ui, U 2 , X 3 , X 4 are independent and identically 
distributed uniformly over F n . Z x and Z 2 , respectively, are uniformly distributed over T niA 
and ^2,3, respectively. They are independent of U%, U 2 , X 3 , X 4 and of each other. We define 

X l = U 1 + Z 1 , 
x 2 = U 2 + Z 2 . 
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Pv 3 \y 3 and Pv 4 \y 4 are defined by the following deterministic test-channels 



Note that this amounts to the destinations truncating their observations to the level at which 
their own private-codewords (e.g., Z\ in the case of destination 3) are received. Thus, the 
quantized observations Vs only contain information on the public- code words (the C/'s). This 
is consistent with the intuition that the information they forward on to the other destination 
is utilized to recover the public-codewords. 

With these choices, the conditions on the non-negative rates for achievability from The- 
orem |3] work out to 



rxi < [ni,3 - rai,4]+, 

r Vl < max (m i3 - [n 1>3 - n M ] + , t* m - [n 2A - 712,3]+) , 
rui < n i,3 ~ [«i,3 - "1,4]+ + r A , 

r U2 < max (n 2 ,3 - [7*1,3 - 7*1,4] +, n 2)4 - [n 2 ,4 - 712,3]+) , 
r U2 < ["2,3 - [7*1,3 - 7ii j4 ]+]+ + r 4 , 
r 4 < [nc - [ni,3 - 711,4]+]+, 



[711,4 - [712,4 - 7*2,3]+]+ + [7*2,3 - [711,3 - 711,4]+]+] , 

if n x> 3 + n 2A ^ 7*1,4 + 7*2,3 
max (n lt 3 - [711,3 - 7ii, 4 ]+), (n 2 ,4 - [7*2+ - 712,3]+), 



(7h,4 - [712,4 - 7*2,3]+), (7*2,3 - K,3 - 7*1,4]+) 

otherwise, 

7-c/i + 7V 2 < max(ni )3 , 7*2,3) - [7*1,3 - **i, 4 ]+ + r 4 , 



V3 = s [ni ' 3 " ni > 4l+ Y3, 
V 4 = s^~ n ^+Y 4 . 




[7*2,4 - 7*2,3]+), 




K,4 



[7*2,4 




7-J/i + 7-4 < 



7*1,3 - [7*1,3 - 7*1,4]+ + 7-4, 




(7*2,4 



[t*2,4 




r U2 + 7-4 < 



[7*2,3 - [7*1,3 - 7*1,4]+]+ + 7 4 , 
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r Ua +r 4 + r Ul < < 



max f (m, 3 - [ni )3 - ni, 4 ]+) + (n 2 ,4 - [n 2 ,4 - n 2j3 ]+), 

[ni,4 - [n 2 ,4 - ^2,3]+]+ + [n 2 , 3 - [^1,3 - "1,4]+]+, 
[no - K,3 - "1,4]+]+ + (max(ni, 4 , n 2 , 4 ) - [n 2 , 4 - "2,3]+) J 7 

if ui )3 + n 2 , 4 ^ n 1A + n 2>3 
max f(ni i3 - [n h3 - n M ] + ), (n 2j4 - [n 2)4 - 712,3]+), 

(m j4 - [n 2 ,4 - ™ 2 , 3 ] + ), (7i 2 ,3 - [7il,3 - 7J, M ] + ), 

[n c - [n li3 - 7ii )4 ] + ] + + (max(m, 4) n 2 , 4 ) - [n 2j4 - ^2,3]+)^ , 

otherwise, 

+ r 4 + < max(n li3 , n 2 , 3 , n c ) - [n h3 - n lA } + + r 4 , 

and the corresponding inequalities with subscripts 1 and 2 exchanged, and 3 replaced with 
4. Applying Fourier-Motzkin elimination to these conditions, we can show that a sum-rate 
equal to the minimum of the following terms is achievable in this regime. 

u 2 = max(n 2j4 , n 2)3 ) + (max(ni )3 , n 2 , 3 , n c ) - n 2i3 ) , 
u 3 = max(ni i3 ,ni i4 ) + (max(n 2)4 , ni )4 , nc) - rii )4 ) , 
U4 = max(n li3 , n c ) + max(n 2j4 , n c ), and 

_ f max(ni 53 + n 2j4 , n M + n 2 , 3 ), if 7ii )3 - n 2)3 7^ n M - n 2A , 
"' 1 max(n M ,n 2i4 ,n M ,n 2i3 ), otherwise. 



D Proof of the achievability of Theorem [2 

The proof of Theorem [2] will follow the proof of Theorem [T] closely. We first make the 
following definitions: 



n k u k 2 = [log\g klM \ 

de f n i i2i 
n c = [log \g c \ U 



k x ,k 2 E {1,2,3,4}, and 



Let us observe that the minimum of the following four terms u'i, u 2 , u' 3 , and u' A are within a 
constant (log 25 bits) of the minimum of the corresponding unprimed terms, Ui,u 2 ,u 3 , and 

M 4 . 



Un 



tin 



u. 



max(rii i3 - n lj4 + n c , n 2)3 , n c ) + max(n 2 , 4 - n 2j3 + n c , n 1A , n c ), 
max(ni i3 , n 2 , 3 ) + (max(n 2j4 , n 2 , 3 , n c ) - n 2 , 3 ) , 
max(n 2i4 , n 1A ) + (max(ni j3 , n M , n c ) - n lA ) , 
max(ni i3 , nc) + max(n 2i4 , n c ). 
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Hence, it is enough to show that the minimum of the four terms above and 

«5 = lo S (l + (l^l,3 1 2 + \92,4\ 2 + \9lA\ 2 + 1^2,3 1 2 ) 

+ (|01,302,4| 2 + \9lA92,3\ 2 ~ ^\9l,392,49lA92,3\ COS 6 

which is also within a constant (3 bits) of U5, is achievable. We again consider the same 
three regimes as in Appendix |C| 

Regime (i): \g c \ < \gi,j\, i G {1,2}, j G {3,4}. 

We will assume that \gc\ > 1. If \gc\ < 1, it can be verified that our upperbound is 
not more than 4 bits away from the upperbound for the corresponding Gaussian interference 
channel without a cooperation link {i.e. gc = 0) in [2] which itself is known to be achievable 
with a gap of at most 2 bits. Hence overall, if \gc\ < 1, the upperbound is achievable with 
a gap of 6 bits. 

Further, we will show achievability only for the case where 2\gc\ < min(|pi ^1, | ^2,3 1 ) - Note 
that the upperbounds change by at most 1 bit if we do not impose this restriction (but still 
maintain the restriction that \gc\ < \9i,j\, i G {1,2}, j G {3,4}), and achievability of a given 
sum-rate at a lower value of \gc\ implies its achievability for all larger values of \gc\ (i.e., 
the sum-capacity is monotonic in \gc\) provided the rest of the channel coefficients remain 
the same. Hence, showing achievability under this restricted \gc\ regime implies a proof of 
achievability for the whole regime with a further gap of 1-bit from the upperbound. 

Let us define 

#1,402,3 

9i,39c 

91,492,3 
92,49c 

We first note that in regime (i) with the additional assumptions we made above, if both 
Ax,A 2 > 1/2, then our upperbound can be shown to be not more than 10 bits from the 
upperbound in [2] for the Gaussian interference channel without a cooperative link. Since 
that upperbound is known to be achievable within two bits, the gap to the upperbound is at 
most 12. Hence, we will only consider the other three possibilities: (a) A\ < 1/2, A 2 < 1/2, 
(b) Ay < 1/2, A 2 > 1/2, and (c) A x > 1/2, A 2 < 1/2. We will show achievability for 
cases (a) and (b). Case (c) will follow from case (b) by symmetry. 

The coding scheme will very closely resemble the one we used for regime (i) in Appendix [Cj 
We repeat all the details below for completeness. 

For ), let us consider the following block-Markov scheme with superposition coding. 

Let Uk, Sk, Z^k, Z^ki k — 1, 2 be independent auxiliary random variables with marginal dis- 
tributions pu k ,ps k ,Pz n ,Pz lk - The alphabet for these random variables is the set of complex 
numbers. Corresponding to these random variables, random codebooks of blocklength-T and 
rates r Uk ,r Sk ,r Zn ,r Zlk , respectively, are defined as usual. For instance, the t/i-codebook, 



dcf 
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denoted by Cu 1 , is of size 2 T( - n/ i~ e - ) is generated by choosing the T elements of each of the 
codewords independently according to pui- These codewords will be denoted by ^(m^) 
where G {1, . . . , 2 T ( ru i~ t * ) }. The blocks will be indexed by j = 1, 2, . . . , J. The message 
transmitted by source 1 using the f/i-codebook in block- j will be denoted by m^j), and 
the corresponding codeword by eg = cy 1 (m Ul (j)). 

For block-j, sources transmit the following blocklength-T vectors 

vU) _ JJ) i Jj) , Jj) , A')) 

^-1 — C l/i + C Z T1 "+" C Z U "+" JSi > 



where 



JSi — C Si + ^l c Si + • • • + A l c Si > 
/5 2 _ c 5 2 + /1 2C 52 -t- . . . -t- A 2 c s 2 ■ 

In the sequel we will ensure that the rates of the codebooks are such that from observing 
Y 3 \ the j-th block observed by destination 3, it (destination 3) can decode with a high 
probability of success the codewords eg, eg, and cg^, for all j. Similarly, we will make 

sure that destination 4 will successfully decode eg, eg, and cg 2 from Y± \ Then, the 
destinations will transmit, respectively, for j = 1, 2, . . . , J — 1, 

xt 1] = a, (y 3 w - ^ (4 } + ^ + o - (4~ 1} + > 

= ^4 (l^ - ^ 2 , 4 (eg + eg + egj - g c A 3 g 2 , 3 (cg^ + cg^)) , 
where, A 3 and A 4 are defined below 

92,3 



A 4 = 
A 3 = 



9C92,4 A 2 ' 
01,4 

gcgi^M ' 



The choices for the distributions and the fact that the power constraints are satisfied will be 
taken up in the sequel. 

With these, the received signals at the destinations are 

Y 3 U) = gijFHcut + c Zn ) + gi , 3 (f£) + 9$>Xc Zll ) + <? 2 , 3 (cg + c%) + g3 0) (c Zi2 ), 

^ = ^4 (j) (ct/ 2 + % 2 ) + jM/g) + ^ W (cz ia ) + ^l,4(cg + cgj + ^(Czj, 

where the functions are as defined below. Note that Y 3 does not have any terms which depend 
on ^-codewords (and similarly, Y4 does not involve any terms containing Si-codewords). 
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This was achieved by the appropriate choices above for A 1 and A 4 (respectively, A 2 and A 3 ). 
Here 



9^ {j \cu, + c Zn ) = + c%) + g c A Agi M; l) + 

^3(cg+cg T ) 2 )=^3(cg+cg 2 ), 



9Tz 3 \cz l2 ) 



E (go^gcA?) 2 gi,^^ + E {gcMgcM) 2 gcMgi,A c z lV 

ie{j,j-2,...,i} ie{j-i,j-3,...,i} 

gcA 4 g 2 ,4cy i2 



(gcA 4 gcA 3 y V 'g2,3C { z\ 2 + Yl 
ie{j,j-2,...,i} - <j \,j i; 



+ E (9cA 4 g c A 3 )^N?+ £ 

ie{j,j-2,...,l} i£{j-l,j-3,...,l} 



gcA^gcA^gcAz) 1 ^ 1 



and the functions g2~fi\cz l2 ), #1,4(0^ + c^\), and g*^ J ' ' (cz^) are defined similarly. 

As before, destinations perform decoding in two phases. At the end of every block j, 
the destinations decode the off, c<^ and intended for them (in that order). We call this 
phase 1 decoding. At the end of block- J, the decoders perform a phase 2 decoding where it 
decodes the following codewords for all blocks, i.e., for each j — 1, 2, . . . , J, the destinations 



decode cjp intended for the other user and intended for itself (in that order). In both 
of the phases, the decodings are performed in the order mentioned above treating all the 
undecoded codewords and other interference as noise. Below, we will specify the distributions 
employed and evaluate the conditions on the rates to ensure successful decoding. This will 
establish achievability for regime (i). 

The auxiliary random variables are all Gaussian with the following powers: 



0) 



a 



Ui 



-I 



1/K, 



a 7 = 



= 



1 

K 
1 

K 
1 

K 



gc 



5-1,4 

1 

01,4 
#2,3 



gizgc 



where K is a constant which will be chosen presently to satisfy the power constraint. The 
power allocation for the auxiliary random variables for source 2 is chosen similarly. 
Destination 3 transmits 



= A 3 (gr^(c Zll ) + g 2 Ml + + d/'^) 



(j) , „Ci) 



-Ci), 
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If 2|<7c| < | c?i,4 1 , | ^2,3 1 and | c?c7 1 > 1, under the above power allocation, the average power of 
these terms can be shown to be 



< 



(l/T)\\A 3 ^\c Zll 
{l/T)\\A,g 2 Ml + c%)\\ 2 <2/K 
(1/T)E 



9c\ 



\\AsgU U \c z 



< 



{2 /K) + 2 



102,3 1 



We can easily verify from this that if we choose K — 9, the power constraints at all the 
transmitters are satisfied. The rates supported by the above scheme for source 1 are given 
by the following set of conditions 



ru! < log 1 + 



|gl,3| 2 

K 



2|ffl,3ffd 2 



+ 



|gl,3| 2 



< log 1 



K\g 1A \ 2 ^ «-|fll,4| 2 

\91A? 
K 



+ 



2|g2,3| 2 

K\g c \ 2 



+ 



2|g2,3l 2 
K 



+ i + 2 



\9ia\ 2 
K\g c \ 2 



_|_ 2l 
K ^~ K 



rsi < log 1 + 



rz n < log 1 + 



2|g2,3| 2 

K 



+ 



\giM 2 



+ 



-2 t 

|gl,3gc| 2 

K\gi A \ 2 
2|92,3l 2 



K\gi A \ 2 ^ K\g c \z 

lffi,3| 2 
K\gi A \ 2 



+ 



2|g2,3l 2 
K 



+ i + 2 



2|ff2, 3 | 2 , 2|g 2 , 3 | 



r Zll < log 



K 

\92,3? 

1 + 2 



+ 



K\gcV 



+ 



2|g2, 3 | 2 
K 



+ i + 2 



The first constraint on ru 1 comes from the phase 1 decoding at destination 3, while the 
second condition is from the phase 2 decoding at destination 4. A similar set of constraints 
apply for the rates achievable by source 2. 

Simplifying, these constraints imply that rates which satisfy the following are also achiev- 
able 

r Vl < K,4 - n c \ - 4, 
rui < - 4, 

rsi <n c - [n 2 ,3 - (ni >3 - n M )] + - 4, 
r Zn < [ni >3 - n 1A - n 2>3 ] + - 4, 
r Zll < [n 2>3 -n c }+- 5. 

Combining all these, an achievable sum-rate is given by 

R sum = max(ni )3 - n M + n c , n 1>3 - n c ) + max(n 2 , 4 - n 2 , 3 + n c , n 2A - n c ) - 34 
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This, combined with the fact that the achievability of a given sum-rate at a lower value 
of \gc\ implies its achievability for all larger values of \gc\ provided the rest of the channel 
coefficients remain the same allows us to conclude that the minimum of the following three 
terms is achievable with a gap of 34. 

"i,3 - "1,4 + "c + n 2A - n 2 , 3 + "c, 
"i,3 + "2,4 - "1,4, and 

"2,4 + "1,3 - "2,3- 

The above minimum is also the minimum of u[, u 2 , u' 3 under case (a). This shows achievability 
in case (a). 

Let us now consider case (b) where A 1 < 1/2, but A 2 > 1/2. The achievable strategy 
we use for this case involves source 1 transmitting according to a scheme similar to the one 
above while source 2 employs a superposition coding scheme similar to that of Han and 
Kobayashi for the interference channel without a cooperative link. In particular, only node 3 
uses its transmission capabilities. 

The codebooks and the choice of distributions (power allocations) for source 1 is exactly 
as above, except for the choice of rates which will be presented in the sequel. Source 2 uses 
only the following codebooks: U 2 and Z^ 2 . Moreover, the choice of a^ l2 is different. 

1 1 



A |<72,3 1 

Exactly as in the above scheme, destination 3 performs a two-phase decoding and transmits 
a scaled version of the residual signals after the first phase of decoding of the previous block. 
The scaling factor A 3 is the same as above. Destination 4, on the other hand, performs 
only a single phase of decoding where U 2 , U\ and Zyi codewords are decoded. As mentioned 
earlier, destination 4 does not transmit anything, i.e., A A = 0. The received signals can be 
seen to be 

Y 3 U } = <?i, 3 (cg + c% + /£> + c%) + glMl + c%), 

n W = <?2,4(cg + c%) + g c A 3 g 2 M; l) + 4^) + ^(cg + c%) + ^KJ, 
where, unlike above, 

9l, U \c Zll ) = gx A c% + gcA^A;? + + g c A*Nt X \ 

and the other functions are as before. Note that, again the appropriate choice of A 1 and A 3 
has ensured that no contribution from the Si codeword is observed at destination 4. The 
fact that the power constraints are satisfied at all the transmitters under the earlier choice 
of K = 9 is easy to verify. 

Decoding at destination 3 proceeds as in the above scheme. Whereas, destination 4 
decodes, at the end of each block, (i) first, the U 2 and U\ codewords jointly treating all other 
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^1,3 1 
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K 












2|« 7 i,3<?cl7(^i,4| 2 ) + k3l7(^b M | 


2 ) + \g 2 tf/{K\g c \*) + |«? 2 , 3 | 


2 + l 



signals and interference as noise, and then from the residual signal (ii) codeword treating 
interference as noise. The conditions on the rates for successful decoding are given below. 

r Vl < log ^1 + 

r Sl < log ^1 + 

r Zn < log ^1 + 

r U2 < log ^1 + 

r Zll <log(l + 





9i,39c\ 2 /(K\g 1A \ 2 ) 


2\g 2 , 3 \yK+\g h3 \y(K\g 1A \ 


2 ) + \92fl\ 2 /(K\g c \ 


2 ) + Ifesl 


2 + l 





9l,3 1 


2 /(k\ 9ia 


I 2 ) 


2\g 2 , 3 \ 2 /K+\g 2 , 3 \y{K\gc\ 2 ) + |<?2,3i 


2 + i 





92,s\ 2 /K 


\92, 3 \ 2 /(K\g c 


*| 2 ) + 1 + 1 



\92,a\ 2 /(K\9c\ 
1 + 1 



ru 2 < log ^1 + 

r Vl < log ^1 + 

r U2 + r U! < log ^1 + 

rz l2 < log 1 + 



\92 A \ 2 /K 



\92a\ 2 /(K\92,3\ 2 ) + l/K + 3/2^ + 3/2; ' 

MVg \ 

\92 A \ 2 /{K\g 2 tf) + + 3/2X + 3/2 J ' 

\92 A \ 2 /K+\g lA \ 2 /K \ 
\92 A \ 2 /{K\g 2 ^) + + 3/27T + 3/2 J ' 

b,4l7(^ 2 , 3 | 2 ) \ 

1/^ + 3/2^ + 3/2/ ' 



where the first five conditions ensure successful decoding at destination 3 and the rest of the 
three conditions does the same for decoding at destination 4. We may simplify the terms to 
conclude that rates which satisfy all the conditions below are achievable. 

ru! < K,4 - n c ] - 4, 
ru 2 <n c -4:, 

r Sl <n c - [n 2)3 - (^1,3 - "1,4)]+ - 4, 
rz n < [ni >3 - ni )4 - n 2)3 ]+ - 4, 
rz u < [n 2 ,3 -n c ]+- 5, 
r{/ 2 < min(n 2 ,3,n 2 ,4) - 5, 

< [ni,4 - [n 2 , 4 - ^2,3]+] - 5, 
ru 2 + r Vl < max(n 2i4 ,ni i4 ) - [n 2A - n 2 , 3 ]+ - 5, 
rz l2 < K,4-n 2 , 3 ]+ -4. 

Upon simplifying, we may conclude that a sum-rate equal to the minimum of the following 
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terms is achievable within 28 bits 

7*1,3 + [7*2,4 - ^2,3] + , 

7*1,3 — 711,4 + max(ni ) 4, n 2 ,4), and 
7*1,3 + 7^c•• 

This is the minimum of u'^u^, and u 3 under case (b). Thus, we have shown achievability 
under case (b) as well. 

Overall, we have shown achievability of the upperbound in regime (i) with a gap of at 
most 40 bits. 

Regime (%%): As in Appendix [Cj achievability in regime (i) implies the achievability in 
regime (ii) as well since in this regime 

ui(nc) > mm(u' 2 (nc),u' 3 (nc),u' 4 (nc),u' 5 ), 

and u' 2 (n c ), u' 3 (n c ), u' 4 (n c ) and u' 5 are constants. 

Regime (Hi): Note that we proved Theorem [3] for discrete alphabets, but the extension 
to the continuous alphabet case is standard and we will assume that version for proving 
achievability here. 

We apply Theorem [3] with the following choices for the auxiliary random variables. 
Zi, Z 2 , Ui, U 2 , X 3 , X± are independent and identically distributed zero-mean Gaussian ran- 
dom variables. The variances are, respectively 

l/K 
max(l, |#i,4| 2 )' 

l/K 
max(l, |# 2 ,3| 2 )' 
l/K, 

1, 



u 2 + z 2 . 

It is easy to see that this satisfies the power constraint since K = 1/2. Pv 3 \y 3 and Pv 4 \y 4 aie 
defined by the following test-channels 

V 3 = Y 3 + Q 3 , and 
V 4 = Y 4 + Q 4 , 

where Q 3 and Q 4 are independent, zero-mean Gaussian random variables which are also 
independent of Y 3 ,Y 4 and all the other auxiliary random variables. Their variances are, 



where we set K = 1/2. Further, 



(J z 1 



°z 2 



2 2 



A 2 
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respectively 
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max ( 1, 
max 1, 



maxi 
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\9iA 2 ) 


maxi 


1- 


\9iA?) 


maxi 


1, 


\92,i\ 2 ) 


maxi 


1, 


If2,3| 2 ) 



and 



Note that this choice amounts to the destinations quantizing their observations with the 
quantization noise level set to the power level at which their own private-codewords (e.g., 
Zi in the case of destination 3) is received. This is consistent with the intuition that the 
information they forward on to the other destination is used to recover only the public- 
codewords. 

With these choices, it can be shown that Theorem [3] implies that the non-negative rates 
r Xi, r Xii r Un r u 2 i r 3; r 4 can be achieved if the following conditions are satisfied 

rxi < K,3 - 2, 

r Vl < max(ni i3 - [m )3 - n M ] + ,n M - [n 2 ,4 - "2,3]+) - log 36, 

< n 1(3 - [ni, 3 - n 1)4 ]+ + r 4 - 3, 
r U2 < max(n 2 ,3 - [n 1)3 - n 1A } + ,n 2A - [n 2j4 - "2,3]+) - log 36, 
ru 2 < ["2,3 - [ni, 3 - 7ii,4]+]+ + r 4 - 3, 

7-4 < [^C - K,3 - ^1,4]+]+ - 1, 



+ r U2 < log 1 + 



01,3 



a 'l 



+ 



52,4 



«2 



+ 



91A 



a 2 



+ 



92,3 
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51,352,4 


2 
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5i,452,3 


2 

- 2 




aia 2 




ai« 2 





51,352,451,452,3 



cos# — log 36, 



rr/i + r % < max(ni j3 , n 2j3 ) - [ni )3 - n M ] + + r 4 - 3, 

ruj + U < max ^ max(rii i3 , n c ) - [m, 3 - n M ] + , 

K, 4 - ["-2,4 - "2,3]+]+ + [no - K,3 - 7li >4 ] + ]+J - log 36, 
rut +r A < ni ;i - [ni )3 - n M ] + + r 4 - 3, 
ra 2 + n < max ^max(n 2>3 ,n c ) - [m j3 - n M ]+, 

("2,4 - ["2,4 - "2,3]+) + ho - ["1,3 - n M ] + ] + J - log 36, 
ru 2 + r A < ["2,3 - ["1,3 - "-1,4]+]+ + r 4 - 3, 



r U2 + r 4 + r Vl < log 1 + 



5l,3 



a 1 



+ 



52,4 



Q'2 



+ 



5l,4 



Q'2 



+ 



52,3 



O'l 



+ 



5o 



a 1 



+ 



5o5i,4 



aia 2 



+ 



5C52,4 



«1«2 
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91,392,4 



OtiOl2 
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a x a 2 



- 2 



01,302,401,402,3 



cos 9 — log 36, and 



r u% + r 4 + r Vl < max(n lj3 , n 2)3 , n c ) - ["1,3 - n M ]+ + r 4 - 3, 



and the corresponding inequalities with subscripts 1 and 2 exchanged, and 3 replaced with 
4. Above, we used 
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1, 


92,4 
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1, 


92,3 





and 



To illustrate, we show how a couple of the above conditions are arrived at. The rest are also 
derived similarly. Two of the conditions on ru 1 + rjj 2 from Theorem [3] are 



r Vl + r U2 < I{Ui, U 2 ; Y 3 , V 4 \X 3 ,X 4 ), and 

r Vl + r U2 < I{U X , U 2 ; Y 3 \X 3 , X 4 ) + r 4 - I(Y 4 ; V 4 \X 3 , X 4 , U u U 2 , Y 3 ) 



(12) 
(13) 



Below, we show the following: 



I(U X , U 2 ;Y 3 ,V 4 \X 3 , X 4 ) > log 1 + 



01,3 



+ 



02,4 



a 2 



+ 



01,4 



a 2 



+ 



02,3 



+ 



01,302,4 



aia 2 
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01,402,3 



a x a 2 



- 2 



Ol 

01,302,401,402,3 



a\a 2 



COS6 1 — log 36, 



I(U X , U 2 ; Y 3 \X 3 , X 4 ) > max(n 1)3 , n 2j3 ) - ["1,3 - n M ]+ - 2, and 

/(r 4 ;\/ 4 |x 3 ,x 4 , z/i,c/ 2 ,y 3 ) < 1. 



This will allow us to conclude that in order for r^, rjj 2 to satisfy ( 12 )-( 13 ), it is enough if 
they satisfy 



rux + r U2 < log 1 + 



01,3 



a 1 



02,4 



a 2 
+ 



01,4 



ft'2 



01,302,4 



Ct X a 2 
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02,3 



a x 



01,402,3 



a x a 2 



01,302,401,402,3 



cos 9 — log 36, and 



rc/i + m 2 < max(n li3 , 712,3) - [n x , 3 - n Xy4 ] + + r 4 - 3. 
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From the choices for the auxiliary random variables we made, 
I(U 1 ,U 2 ;Y 3 ,V 4 \X 3 ,X A ) = I 



= I 
> I 



Is 

OL2 J 



#1,3 92,3 
9l,4 92,4 



91.3 92,3 

91.4 92,4 
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where Q 3 is a unit variance Gaussian random variable independent of everything else. In the 
last step, we defined the Gaussian vectors U,H,N, and Q. Note that ^ is a unit variance 
Gaussian random variable which makes Q a Gaussian random vector whose covariance matrix 
is the identity matrix I. Also, note that the covariance matrix of U is Ku = K 2 I. Continuing, 



/(c/i,c/ 2 ;n,^4|^ 3 ,^4)>iog 

> log 



HKuHt + K N + I 

|K N + I| 
HKuHt + 1 



K N + I| 



From the choices made for the variances of Zi, Z 2 , we can find a uniform upperbound for 
the denominator for all possible channels: 

|K N + I| < 9. 

Evaluating the lowerbound on I(U\, U 2 ; Y 3 , V r 4 |X 3 ,X 4 ) using this and substituting K = 1/2, 
we can show that 



I(U 1 ,U 2 ;Y 3 ,V 4 \X 3 ,X 4 )>\og\l + 



01,3 



+ 



92,4 



+ 



91,392,4 



a 2 

2 
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91,4 



a 2 
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92,3 



a\a 2 
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91,492,3 



a\a 2 



- 2 



91,392,491,492,3 



cosQ — log 36. 



Similarly, 



I(U U U 2 ; Y 3 \X 3 , X 4 ) = I(U U U 2 ; g li3 U 1 + g 2j3 U 2 + g lfl Z 1 + g 2 , 3 Z 2 + N 3 ) 
>log( 1 + 





9i,3\ 2 /K + 


92, 3 \ 2 /K 


1 


■f max 


f-i max(l,|gi i3 | 2 )\ 
V 1 ' max(l,| 91 , 4 | 2 ); 



> max(ni i3 ,n 2 ,3) - [n 1}3 - n M ] + - log 4, 
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and 



I(Y,; V 4 \X 3 , X,, U lt U 2 , Y 3 ) < /( 9l , 4 Z, + g 2A Z 2 + N t ; g^Zj + g 2A Z 2 + N, + Q t ) 



l0S l 1 + TT^I sl0g2 = L 



Applying Fourier-Motzkin elimination to the set of all conditions on the rates, we can 
show that a sum-rate equal to the minimum of the following terms is achievable with a gap 
of at most 15 bits in this regime. 

u 2 = max(n 2 , 4 , n 2)3 ) + (max(ni, 3 , n 2 ,3, n c ) - n 2i3 ) , 
u' 3 = max(n li3) n 1)4 ) + (max(n 2 , 4 , n M , n c ) - n M ) , 
u' A = max(ni i 3, nc) + max(n 2j4 , nc), and 

M 5 = lo S (l + (1^1,3 1 2 + \92,4 2 + \9ia\ 2 + \92,3\ 2 ) 

+ (|<7l,302,4| 2 + \9lA92,3\ 2 - 2 lfi'l,3fl'2,45 , l,45 , 2,3| COS O) . 



E Proof of the upperbounds of Theorems [T] and [2 

Upperbounds 1-3 are new, upperbounds 4 and 5 are cut-set upperbounds which also ap- 
peared in the two-user interference channel with source cooperation [10]. Below, we prove 
upperbounds 1-3 and, for completeness, repeat the proofs for upperbound 4 and 5. 
Upperbound 1: 

We create two dummy channels in both of which, all the noise processes are independent 
of those in the original channel, but have identical distributions to their counterparts in the 
original channel. All the nodes use the same strategies as in the original problem (i.e., same 
codebooks at the nodes 1 and 2, and the same fk,ts at nodes 3 and 4), but the messages 
transmitted by the nodes are different from that in the original channel as explained below. In 
the first dummy channel (where all quantities are denoted by adding a prime /) , the message 
at node 1 is identical to the message at node 1 in the original channel, i.e., M[ = Mi, 
however, the message M' 2 at node 2 is independent of the messages Mi,M 2 and distributed 
uniformly over its alphabet. We note that X[ = X\, but X' 2 ,X' 3 , and X' A are, in general, 
different from their counterparts in the original channel. Similarly, M' 2 ' = M 2 , but M" 
is independent of M X ,M 2 ,M 2 and distributed uniformly over its alphabet. We start from 
Fano's inequality. 

T(R 1 + R 2 -o(t)) 

</(M 1 ;F 3 T ) + /(M 2 ;F 4 r ) 

< J(M i; Y 3 T , g$ A (X[ T ) + g 3A (X' 3 T ), M' 2 ) + J(M 2 ; Yj , gl 3 (Xf) + g 4>3 {Xf),M?) 

< /(M i; F3 T ,^ 4 (X; T ) +g 3A (X? )\M' 2 ) + J(M 2 ;y 4 T ,^ 3 (Af ) + g i)3 (Xf )\M»). 
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These two symmetric terms can be further upperbounded. Below we will show how the first 
is upperbounded; the second term can be similarly upperbounded. 

J(M i; Y 3 T , g\ A {X[ T ) + g 3A (X' 3 T )\M' 2 ) 

= H{g\ A {X?) + g 3A {X?)\M> 2 ) + H(Y 3 T \g* 1A (X[ T ) + g 3A (X?), M 2 ) 

- H(Y 3 T \M 1 , M' 2 ) - H(g* lA (X[ T ) + g 3A (X' 3 T )\Y 3 T , M u M' 2 ) 

= H{gUX[ T ) + g M {X' 3 T )\M' 2 ) + H(Y 3 T \g* 1A (X?) + g 3A (X?), K) 

- Hig^iXj) + #4,3 (Xj ) | Mi , M 2 ) - H(g* 1A (X[ T ) + g 3A (X' 3 T )\Y 3 T , M u M' 2 ) 

= H{gUX[ T ) + gz A {X> 3 T )\M> 2 ) + H(Y 3 T \g* 1A (X[ T ) + g 3A (X' 3 T ), M> 2 ) 

- H{gl 3 {X T 2 ) + g^{Xl)\Mi) - H(gl A (X[ T ) + g 3A (X' 3 T )\Y 3 T , M u M 2 ) 

= H{g{ A {X[ T ) + gz A {X' 3 T )\M> 2 ) + H{Y 3 T \g\ A {X[ T ) + g 3A (X' T ), M 2 ) 

- # (<? 2 * 3 (*2 T ) + 9U X l)\ M i) " H(gl A (X[ T ) + g 3A (X' 3 T )\Mi, M 2 ). 

where (a) follows from the fact that Y 3 [t] = gi )3 (X 1 [t])+g 2 ^( y X 2 [t])+g^ 3 (X 4 [t]) and g 1>3 (Xi[t]) 
is a deterministic function of Mi, and (b) is due to the independence of 
(Mi,g 23 (X 2 ),g^ 3 (Xj)) and M 2 . Equality (c) follows from the fact that conditioned on 
Mi, the primed quantities and the unp rimed quantities are independent. Further, we can 
upperbound the second and fourth terms as follows 

H(Y 3 n \gU(X[ T ) + 9sa(K T ), K) < H{Y?\9U X ?) + AM 
-H{gl A {X?)+g 3A {Xi 3 T )\Mi,M> 2 ) 

= E -H(g*i A (X[[t]) + g,AXm\9U X 't l ) + gzAXt 1 ), Mi, M> 2 ) 
t=i 

= E-^07i%(^iW)I^M)- 
*=i 

We combine these and use the following facts 

H(g* A (X?)+g 3A (X?)\M[) = H(g* 1A (X?) + g 3A (Xj)\Mi), 
H(gl 3 (X^)+g 4 , 3 (Xf)\M^ = H^X?) + g 4 , 3 (Xj)\M 2 ). 

We arrive at 

T(Ri +R 2 - o(e)) < H(Y 3 T \g* 1A (X[ T ) + g 3A (X?)) + # flTKs W ) + ^ 3 (Xf )) 
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Linear deterministic case: 
We have 



Ri + R 2 - o(e) < max(n 2i3 , n h3 - n 1A + n 4;3 , n 4j3 ) - + max(n M , n 2j4 - n 2j3 + n 3j4 , n 3)4 ) - 
= max(n 2)3 , n 1>3 - n 1A + n c , n c ) + max(n M , n 2A - n 2j3 + n c , n c ). 



Gaussian case: 
We have, 

Rt + R 2 - o(e) < 



log (l + (|52,3| + |<7c| + I)' + |gf) , if \9iA > max(l, |<? c |) 



+ 



l0g(l + (|^2,3| + |^c| + |^l,3|) 2 ), 
log fl + (|(? M | + + 



92,49c 
92,3 

2 



+ 



92,4 
92,3 



log (l + (\gi,4 + \gc\ + Isv 



otherwise 

, if |# 2 ,3| > max(l, \g c \) 
otherwise 



Upperbounds 2 and 3: 

We start from Fano's inequality. 

T(R, + R 2 - o(e)) < 7(M i; if) + J(M 2 ; F 4 T ) 

< /(M i; r 3 T ) + /(M 2 ;F 4 T ,^ 3 (X 2 r ),M 1 ) 

< J(M i; Y 3 T ) + 7(M 2 ; Yj i ^, 3 (X 2 T ), \M X ) 

<£7(M i; y 3 [i]|y 3 '-V7(M 2 ;y 4 ^^ 

i=l 

Below, we upperbound these terms separately. 

I{M 1 -YMYt 1 ) = mM\Yt l )-Hm]\Yt\M 1 ) 

< H(Y 3 [t\) - H(Y 3 [t]\Y 3 t ~ 1 ,Yl _1 , Mi) 

< H(Y 3 [t]) - H(gl 3 (X 2 [t])\Yt\gU X 2~ 1 ),M 1 ), 

where (a) follows from the fact that Y 3 [t] = g h3 (Xi[t]) + g 2j3 (X 2 [t]) + g 4j3 (X 4 [t\), and X ± [t] 
is a deterministic function of Mi, X 4 [t] is a deterministic function of Y 4 t_1 , and <7 13 and g 4i3 
are deterministic maps. 

= J(M 2 ; ^(XaM)!^ 1 , g^Xf 1 ), M x ) + 7(M 2 ; F 4 [i] \Yf\ g^Xfr Mi). 
We upperbound these two terms separately now. 



I(M 2 ;g* 2 JX 2 [t] ) I Yt 1 , gUX^ 1 ) , M 



1 

77(^ 3 (X 2 [t])|F^\^3(X*- 1 ),M 1 )-77(^ 3 (X 2 [t])|X 2 [t]), 
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which follows from the channel model (memorylessness and independence of the noise pro- 
cesses at the different nodes). 



I(M 2 ;Y 4 [t}\Yt\gU X z)> M i) 

®I(M*Y 4 [t]\Yt\gfa(X t t ),M u Xi[t)) 

= H(Y 4 ,[t)\Y*-\gi 3 {X>),M 1 ,X 3 [t])-H^ 

< #(X 2 [t] +#* 4 (X 1 [t]^ 

® H(X 2 [t] +gUX 1 [t])\g* >3 (X 2 [t}),X 1 [t}) - H(gt A (Xi[t])\Xi[t}), 

where (a) can be seen by noting that: (1) X 3 [t] is a deterministic function / 3>t of Y 3 , (2) 
Kj in turn is such that 

Y 3 (s) = g 1 , 3 (X 1 (s)) + g* 2>3 (X 2 (s)) + g 4 , 3 (X 4 (s)), s<t-l, 

and (3) for all s < t — 1, gi >3 (Xi(s)) is a deterministic function of M%, and g 43 (X 4 (s)) is a 
deterministic function of Y£~ x . Also, (b) follows from the channel model (memorylessness 
and the independence of the noise processes at the different nodes) and the fact that Xi[t] 
is a deterministic function Mi. 
Combining everything, we have 

T(Ri + R 2 - o(e)) < £ {H(Y 3 [t}) - H(gl 3 (X 2 [t))\X 2 [t})} 

t=i 

+ {^(X 2 [t]+^ 4 (X 1 [t])b* 3 (X 2 [t]),X 1 [t])-^* 4 (X 1 [i])|X 1 [t])} 

Linear deterministic channel: We have 

Ri + R 2 - o(e) < {max(ni j3 , n 2j3 , 714,3) - 0} + {[n 2A - n 2:3 } + - 0} 
= max(ni j3 , n 2 , 3 , n c ) + [n 2j4 - n 2>3 ) + . 

Gaussian channel: We have 

Ri+R 2 - o(e) < log(l + (\gi i3 \ + \g 2 , 3 \ + \g c \) 2 ) + log ^1 + 
Upperbound 4 : 

This is a simple cut-set upperbound [12] with nodes 1 and 4 on one side of the cut and 
nodes 2 and 3 on the other. It is easy to verify that 





£2,4 


12 


max 


(1,1 


^2,3 


2 ) 



Ri < max/(Xi;F 3 ,y 2 



vx 



2 



R 2 <mzxI(X 2 ;Y 4 ,Yi). 

Px 2 

Under the linear deterministic model, this translates to an upperbound on the sum-rate of 

Ri + R 2 < max(ni )3 , n c ) + max(n 2)4 , n c ), 
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and for the Gaussian case, we get an upperbound of 

R 1 + R 2 < log (l + |#i, 3 | 2 + \g c \ 2 ) + log (l + \g 2A \ 2 + \dc\ 
Upperbound 5: 

This is also a simple cut-set upperbound. Nodes 1 and 2 are on one side of the cut and 
nodes 3 and 4 are on the other. The resulting upperbound on the sum-rate is 

R x + R 2 < max J(X i; X 2 ; Y 3 , Y 4 ). 

Px lt x 2 



For the linear deterministic case, this gives 
Ri + R 2 < 



max(ni j3 + n 2A , n M + n 2)3 ), if n 1>3 - n-2,3 ^ ™i,4 - n 2A , 
max(ni j3 , n 2A , n 1A , n 2j3 ), otherwise, 



and for the Gaussian case, using the fact the eigenvalues of the input ([Xi,X 2 ]) covariance 
matrix cannot exceed 2, we may upperbound the sum-rate by 

R! + R 2 < log ^1 + 2 (|(?i, 3 | 2 + \g 2A \ 2 + M 2 + \92,s\ 2 ) 

+ 4 (|^l,352,4| 2 + |01,402,3| 2 - 2151,3^2,4^1,452,31 cos 0) ■ 
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